-- Logs begin at Tue 2022-05-10 18:58:24 UTC, end at Tue 2022-05-10 20:15:46 UTC. -- May 10 19:47:16.147420 dv-cinder-841315-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 19:47:16.155870 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 19:47:16 2022] *** May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: nodename: dv-cinder-841315-1-iscsi May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: machine: x86_64 May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: clock source: unix May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: pcre jit disabled May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: detected number of CPU cores: 4 May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: current working directory: / May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: detected binary path: /usr/bin/uwsgi-core May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: your processes number limit is 47680 May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: your memory page size is 4096 bytes May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: detected max file descriptor number: 2048 May 10 19:47:16.157814 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: lock engine: pthread robust mutexes May 10 19:47:16.158719 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: thunder lock: enabled May 10 19:47:16.158719 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 19:47:16.158719 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 19:47:16.202543 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: Python main interpreter initialized at 0x56100f4459c0 May 10 19:47:16.202543 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: python threads support enabled May 10 19:47:16.202543 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: your server socket listen backlog is limited to 100 connections May 10 19:47:16.202543 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: your mercy for graceful operations on workers is 90 seconds May 10 19:47:16.202906 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: mapped 403077 bytes (393 KB) for 2 cores May 10 19:47:16.202984 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: *** Operational MODE: preforking *** May 10 19:47:16.203208 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: *** uWSGI is running in multiple interpreter mode *** May 10 19:47:16.203208 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: spawned uWSGI master process (pid: 102580) May 10 19:47:16.203404 dv-cinder-841315-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 19:47:16.210483 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: spawned uWSGI worker 1 (pid: 102581, cores: 1) May 10 19:47:16.210483 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: spawned uWSGI worker 2 (pid: 102582, cores: 1) May 10 19:47:16.210483 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 19:47:17.404535 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 19:47:17.405465 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 19:47:18.148226 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:47:18.148226 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: from cryptography.utils import int_from_bytes May 10 19:47:18.148562 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:47:18.148562 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: from cryptography.utils import int_from_bytes May 10 19:47:18.149931 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:47:18.149931 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: from cryptography.utils import int_from_bytes May 10 19:47:18.150258 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:47:18.150258 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: from cryptography.utils import int_from_bytes May 10 19:47:20.758586 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 19:47:20.759165 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 19:47:20.759543 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 19:47:20.759626 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 19:47:20.759703 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 19:47:20.759776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 19:47:20.759847 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 19:47:20.759919 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 19:47:20.759997 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 19:47:20.760131 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 19:47:20.760337 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.760482 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.760671 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.760813 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.761001 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.761142 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.761330 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.761468 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.761665 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.761805 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.761981 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.762122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.762306 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.762446 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.762670 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.762788 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.763010 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.763117 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.763279 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.763390 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.763602 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.763700 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.763931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841315-1-iscsi {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.764024 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841315-1-iscsi {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.764259 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.764358 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.764571 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.764664 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.764887 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.764979 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.765212 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.765309 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.765519 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.765612 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.765844 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.765935 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.766153 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.766238 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.766685 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.767086 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.767236 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.767357 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.767474 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.767579 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.767730 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.767844 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.768071 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.768218 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.768390 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.768514 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.768703 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.768840 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.769027 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.769164 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.769340 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.769482 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.769664 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.769851 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.769984 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.770119 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.770365 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841315-1-iscsi {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.770612 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841315-1-iscsi {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.770741 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.770903 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.771038 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.771226 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.771367 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.771548 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.771761 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.771966 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.772099 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.772285 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.772418 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.772602 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.772736 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.772928 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.773073 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.773314 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.773454 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.773639 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.773777 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.773963 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.774098 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.774286 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.774420 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.774633 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.774767 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.774940 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.775074 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.775254 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.775387 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.775565 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.775693 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.775876 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.776009 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.776227 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.776376 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.776502 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.776633 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.776770 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.776900 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.777024 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.777148 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.777336 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.777468 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.777658 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.777791 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.777982 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.778114 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.778242 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.778379 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.778543 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.778670 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.778816 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.778950 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.779139 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.779267 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.779456 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.779582 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.779771 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.779902 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.780083 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.780216 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.780395 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.780527 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.780709 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.780842 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.781022 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.781154 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.781334 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.781471 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.781645 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.781785 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.781959 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.782098 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.782278 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.782411 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.782630 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.782770 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.782952 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.783077 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.783265 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.783403 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.783593 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.783733 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.783911 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.784036 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.784227 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.784365 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.784538 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.784681 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.784881 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.785006 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.785194 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.785332 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.785506 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.785648 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.785830 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.785957 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.786676 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.787124 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.788150 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.789340 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.789471 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.789594 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.789594 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.789834 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.789969 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.790099 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.790099 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.790335 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.790474 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.790610 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.790751 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.790881 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.791012 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.791134 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.791134 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.791376 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.791376 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.791629 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.791758 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.791881 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.792002 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.792132 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.792255 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.792376 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.792376 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.792617 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.792745 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.792881 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.793003 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.793124 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.793244 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.793372 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.793495 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.793629 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.793751 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.793872 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.794000 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.794121 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.794246 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.794376 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.794521 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.794645 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.794779 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.794902 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.795025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.795155 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.795277 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.795405 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.795528 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.795657 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.795793 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.795922 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.796046 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.796177 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.796315 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.796444 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.796576 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.796780 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.796904 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.797025 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.797147 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.797277 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.797399 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.797530 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.797652 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.797781 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.797903 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.798024 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.798154 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.798277 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.798398 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.798550 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.798671 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.798792 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.798926 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.799056 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.799186 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.799320 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.799450 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.799572 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.799711 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.799842 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.799963 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.800084 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.800206 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.800327 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.800463 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.800593 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.800716 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.800851 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.800980 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.801114 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.801249 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.801373 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.801494 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.801622 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.801751 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.802417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.802609 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.802735 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.802864 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.802988 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.803118 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.803255 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.803388 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.803524 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.803685 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.803822 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.803995 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.804132 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.804319 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:47:20.804448 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.804657 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.804792 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.804993 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.805128 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.805344 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.805472 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.805667 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.805808 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.806005 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.806136 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.806346 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.806508 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.806696 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.806832 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.807016 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.807142 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.807336 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.807463 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.807659 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.807797 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.807976 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.808113 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.808294 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.808419 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.808611 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.808746 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.808934 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.809067 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.809255 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.809394 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.809585 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.809712 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.809906 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.810043 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.810230 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.810356 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.810577 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.810723 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.810898 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.811026 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.811223 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.811351 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.811552 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.811695 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.811870 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.812005 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.812185 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.812319 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.812532 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.812668 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.812861 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.812995 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.813188 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.813315 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.813519 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.813654 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.813839 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.813968 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.814156 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.814291 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.814484 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.814625 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.814802 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.814936 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.815133 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.815271 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.815462 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.815589 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.815781 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.815916 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.816101 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.816234 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.816420 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.816547 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.816737 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.816871 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.817060 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.817194 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.817398 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.818007 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.818206 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.818333 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.818572 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.818718 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.818899 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.819033 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.819219 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.819345 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.819540 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.819746 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.819873 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.819996 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.820166 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.820293 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.820505 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.820786 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.820916 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.821097 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.821225 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.821409 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.821538 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.821721 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.821848 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.822031 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.822163 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.822346 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.822533 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.822677 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.822816 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.823001 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.823136 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.823337 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.823473 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.823655 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.823782 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.823972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.824098 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.824294 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.824431 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.824612 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.824738 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.824924 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.825050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.825240 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.825376 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.825555 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.825683 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.825867 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.825992 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.826184 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.826318 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.826517 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.826648 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.826843 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.826982 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.827165 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.827292 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.827478 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.827605 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.827793 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.827920 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.828107 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.828233 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.828419 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.828547 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.828737 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.828873 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.829052 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.829179 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.829368 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.829494 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.829683 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.829809 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.830001 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.830130 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.830320 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.830501 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.830663 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.830807 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.830984 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.831112 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.831313 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.831438 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.831645 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.831787 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.831953 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.832078 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.832284 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.832411 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.832594 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.832734 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.832913 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.833081 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.833785 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.833914 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.834100 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.834236 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.834410 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.834571 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.834751 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.834887 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.835061 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.835188 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.835374 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.835513 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.835680 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.835806 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.835987 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.836114 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.836293 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.836426 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.836600 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.836729 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.836911 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.837040 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.837221 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.837347 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.837532 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.837660 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.837842 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.837969 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.838152 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.838280 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.838507 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.838651 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.838847 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.838975 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.839184 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.839311 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.839509 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.839649 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.839839 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.839974 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.840161 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.840281 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.840485 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.840628 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.840801 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.840934 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.841119 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.841257 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.841434 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.841577 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.841751 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.841889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.842066 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.842193 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.842384 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.842530 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.842736 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.842863 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.843053 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.843180 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.843375 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.843508 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.843693 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.843820 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.844019 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.844144 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.844333 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.844453 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.844655 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.844792 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.844962 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.845088 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.845282 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.845418 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.845626 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.845754 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.845953 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.846086 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.846274 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.846403 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.846623 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.846750 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.846941 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.847076 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.847261 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.847389 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.847574 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.847700 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.847892 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.848030 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.848207 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.848334 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.848524 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.848675 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.848912 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.849059 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.849186 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.849311 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.849499 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.849636 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.849813 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.850020 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.850147 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.850269 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.850437 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.850579 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.850784 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.850913 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.851093 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.851219 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.851414 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.851550 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.851745 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.851878 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.852065 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.852201 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.852378 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.852504 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.852696 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.852832 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.853010 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.853144 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.853322 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.853447 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.853636 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.853774 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.853948 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.854074 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.854257 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.854392 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.854592 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.854724 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.854908 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.855035 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.855223 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.855357 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.855534 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.855662 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.855847 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.855980 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.856156 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.856292 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.856465 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.856590 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.856777 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.856904 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.857092 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.857229 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.857400 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.857527 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.857717 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.857844 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.858041 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.858168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.858354 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.858498 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.858693 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.858818 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.859004 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.859133 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.859311 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.859445 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.859620 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.859748 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.859932 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.860060 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.860243 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.860371 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.860550 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.860668 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.860859 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.860994 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.861168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.861295 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.861493 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.861623 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.861814 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.861941 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.862122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.862250 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.862438 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.862598 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.862781 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.862914 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.863095 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.863222 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.863411 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.863547 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.863722 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.863848 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.864034 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.864170 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.864428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.864580 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.864707 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.864838 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.865006 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.865134 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.865324 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.865466 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.865641 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.865770 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.865962 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.866088 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.866274 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.866401 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.866617 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.866762 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.866929 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.867055 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.867235 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.867375 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.867553 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.867687 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.867860 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.867986 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.868176 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.868439 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.868568 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.869033 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.869305 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.869443 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.869643 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.869772 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.869967 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.870107 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.870294 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.870430 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.870648 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.870780 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.870977 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.871105 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.871314 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.871451 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.871627 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.871763 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.871947 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.872074 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.872261 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.872409 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.872572 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.872702 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.872889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.873016 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.873199 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.873325 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.873510 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.873648 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.873820 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.873954 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.874131 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.874260 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.874440 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.874691 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.874819 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.874943 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.875067 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.875191 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.875371 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.875509 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.875694 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.875823 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.876005 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.876133 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.876324 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.876454 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.876636 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.876765 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.876960 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.877085 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.877272 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.877399 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.877583 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.877712 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.877893 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.878021 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.878201 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.878335 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.878535 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.878665 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.878849 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.878978 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.879195 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.879325 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.879508 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.879637 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.879849 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.880503 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.880690 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.880816 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.881005 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.881133 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.881333 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.881469 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.881643 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.881777 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.881956 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.882085 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.882265 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.882400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.882601 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.882730 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.882914 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.883043 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.883224 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.883390 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.883540 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.883674 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.883851 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.883979 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.884165 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.884292 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.884479 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.884604 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.884786 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.884911 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.885100 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.885227 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.885406 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.885540 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.885719 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.885845 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.886027 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.886156 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.886333 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.886477 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.886669 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.886789 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.886979 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.887106 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.887289 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.887416 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.887595 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.887735 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.887908 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.888034 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.888216 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.888343 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.888528 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.888663 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.888835 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.888962 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.889146 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.889274 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.889452 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.889591 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.889762 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.889890 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.890073 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.890200 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.890379 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.890550 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.890718 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.890844 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.891026 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.891154 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.891335 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.891463 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.891643 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.891779 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.891953 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.892080 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.892259 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.892386 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.892569 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.892696 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.892875 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.893001 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.893185 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.893314 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.893501 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.893629 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.893812 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.893939 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.894126 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.894263 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.894431 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.894576 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.894766 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.894904 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.895075 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.895204 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.895385 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.895549 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.896238 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.896378 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.896549 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.896679 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.896856 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.896989 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.897160 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.897295 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.897467 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.897592 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.897776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.897903 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.898083 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.898220 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.898392 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.898560 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.898730 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.898861 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.899039 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.899165 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.899351 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.899480 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.899662 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.899791 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.900008 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.900137 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.900317 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.900458 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.900636 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.900762 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.900962 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.901094 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.901280 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.901417 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.901599 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.901727 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.901916 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.902044 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.902222 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.902349 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.902563 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.902692 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.902876 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.903013 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.903192 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.903318 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.903501 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.903638 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.903815 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.903944 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.904121 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.904247 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.904429 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.904630 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.904757 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.904888 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.905057 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.905186 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.905370 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.905506 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.905696 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.905825 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.906004 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.906133 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.906320 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.906478 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.906666 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.906786 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.906983 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.907110 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.907297 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.907426 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.907610 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.907735 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.907923 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.908051 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.908239 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.908366 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.908554 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.908687 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.908871 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.909004 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.909188 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.909318 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.909500 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.909635 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.909812 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.909946 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.910124 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.910265 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.910432 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.910588 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.910784 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.910921 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.911100 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.911246 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.911431 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.911560 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.911745 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.911882 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.912056 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.912196 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.912372 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.912501 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.912682 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.912817 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.913052 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.913178 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.913365 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.913500 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.913724 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.913858 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.914037 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.914165 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.914353 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.914538 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.914700 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.914830 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.915026 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.915147 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.915344 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.915470 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.915652 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.915779 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.915975 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.916100 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.916284 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.916412 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.916703 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.916833 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.917020 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.917154 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.917330 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.917459 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.917641 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.917777 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.917948 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.918083 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.918258 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.918394 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.918595 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.918723 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.918908 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.919036 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.919219 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.919358 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.919531 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.919660 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.919841 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.919968 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.920165 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.920300 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.920472 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.920598 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.920798 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.920933 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.921191 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.921325 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.921523 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.921657 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.921835 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.921975 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.922218 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.922345 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.922572 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.922701 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.922890 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.923017 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.923217 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.923346 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.923527 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.923653 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.923850 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.923999 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.924160 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.924287 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.924479 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.924608 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.924795 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.924930 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.925108 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.925234 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.925429 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.925558 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.925741 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.925870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.926058 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.926185 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.926367 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.926549 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.926717 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.926863 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.927067 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.927201 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.927385 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.927512 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.927710 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.927838 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.928108 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.928249 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.928436 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.928564 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.928750 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.928885 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.929066 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.929208 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.929376 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.929506 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.929691 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.929818 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.930001 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.930142 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.930313 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.930447 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.930651 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.930778 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.930966 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.931093 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.931284 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.931412 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.931592 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.931725 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.931905 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.932032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.932216 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.932346 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.932526 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.932654 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.932834 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.932961 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.933145 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.933274 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.933472 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.933600 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.933783 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.933923 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.934108 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.934235 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.934426 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.934598 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.934762 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.934889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.935091 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.935219 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.935399 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.935535 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.935710 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.935848 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.936019 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.936148 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.936327 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.936463 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.936637 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.936765 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.936948 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.937068 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.937283 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.937418 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.937596 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.937722 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.937922 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.938058 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.938239 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.938366 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.938597 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.938737 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.938916 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.939044 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.939237 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.939365 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.939560 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.939690 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.939880 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.940014 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.940189 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.940316 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.940499 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.940627 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.940812 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.940938 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.941120 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.941249 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.941426 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.941560 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.941733 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.941870 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.942042 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.942178 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.942361 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.943013 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.943198 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.943334 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.943507 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.943641 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.943817 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.943952 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.944126 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.944264 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.944451 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.944580 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.944761 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.944889 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.945069 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.945247 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.945382 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.945495 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.945678 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.945805 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.945985 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.946112 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.946296 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.946436 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.946665 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.946795 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.946981 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.947111 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.947302 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.947429 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.947622 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.947748 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.947939 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.948075 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.948267 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.948396 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.948578 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.948703 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.948895 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.949022 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.949214 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.949352 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.949531 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.949667 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.949846 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.949973 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.950163 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.950298 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.950507 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.950653 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.950817 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.950945 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.951135 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.951262 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.951451 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.951580 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.951769 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.951895 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.952086 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.952296 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.952434 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.952632 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.952918 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.953046 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.953253 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.953388 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.953571 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.953698 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.953890 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.954016 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.954204 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.954333 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.954547 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.954677 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.954868 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.954994 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.955183 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.955317 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.955500 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.955627 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.955813 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.955940 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.956130 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.956267 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.956462 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.956592 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.956790 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.956919 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.957113 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.957249 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.957436 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.957601 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.957760 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.957888 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.958647 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.958801 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.958977 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.959107 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.959300 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.959429 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.959631 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.959760 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.959954 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.960083 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.960264 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.960469 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.960596 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.960722 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.960891 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.961020 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.961211 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.961348 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.961530 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.961659 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.961848 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.961984 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.962165 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.962301 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.962504 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.962636 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.962826 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.962957 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.963143 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.963281 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.963461 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.963589 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.963782 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.963911 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.964111 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.964247 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.964444 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.964570 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.964772 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.964901 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.965092 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.965220 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.965414 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.965619 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.965748 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.965948 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.966249 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.966378 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.966599 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.966728 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.966941 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.967084 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.967280 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.967400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.967610 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.967738 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.967933 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.968071 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.968260 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.968389 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.968578 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.968706 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.968894 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.969031 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.969207 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.969344 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.969517 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.969644 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.969831 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.969967 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.970142 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.970271 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.970481 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.970611 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.970798 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.970926 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.971111 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.971240 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.971439 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.971647 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.971783 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.972000 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.972281 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.972410 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.972634 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.972762 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.972961 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.973090 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.973283 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.973423 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.973619 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.973752 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.973953 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.974081 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.974266 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.974393 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.974608 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.974751 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.974922 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.975051 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.975242 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.975370 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.975556 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.975693 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.975869 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.976006 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.976188 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.976317 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.976508 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.976821 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.976950 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.977141 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.977270 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.977452 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.977589 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.977772 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.977901 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.978086 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.978214 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.978399 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.978599 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.978726 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.978851 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.979040 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.979168 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.979352 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.979481 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.979666 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.979803 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.979977 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.980112 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.980287 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.980415 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.980597 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.980725 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.980905 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.981032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.981217 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.981353 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.981526 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.981654 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.981841 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.981976 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.982150 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.982278 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.982479 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.982608 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.982803 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.982944 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.983119 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.983249 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.983472 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.983600 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.983791 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.983932 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.984100 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.984220 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.984411 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.984532 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.984735 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.984863 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.985051 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.985173 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.985369 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.985481 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.985684 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.985798 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.986003 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.986117 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.986354 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.986589 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.986721 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.986934 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.987233 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.987347 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.987573 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.987695 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.987899 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.988086 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.988239 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.988452 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.988587 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.988850 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.988975 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.989175 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.989315 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.989529 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.989650 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.989861 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.990046 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.990181 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.990391 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.990543 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.990787 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.990978 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.991115 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.991238 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.991438 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.991554 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.991753 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.991889 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.992071 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.992198 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.992384 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.992511 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.992701 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.992831 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.993016 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.993146 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.993332 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.993469 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.993648 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.994023 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.994219 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.994355 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.994587 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.994727 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.994916 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.995052 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.995235 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.995362 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.995555 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.995692 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.995877 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.996006 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.996191 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.996321 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.996506 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.996642 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.996817 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.996951 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.997132 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.997259 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.997450 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.997593 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.997782 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.997911 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.998098 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.998224 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.998408 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.998576 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.998854 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.998990 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.999171 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.999300 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.999498 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.999626 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.999824 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:20.999958 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.000138 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.000265 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.000465 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.000594 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.000792 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.000928 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.001118 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.001253 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.001443 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.001571 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.001762 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.001897 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.002092 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.002227 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.002433 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.002592 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.002788 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.002915 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.003117 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.003252 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.003425 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.003551 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.003734 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.003871 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.004044 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.004185 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.004358 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.004485 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.004681 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.004815 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.005507 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.005636 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.005815 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.005943 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.006125 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.006251 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.006439 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.006583 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.006777 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.006906 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.007088 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.007217 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.007397 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.007525 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.007709 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.007838 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.008020 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.008155 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.008327 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.008448 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.008635 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.008769 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.008941 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.009077 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.009249 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.009376 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.009554 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.009681 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.009861 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.009999 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.010174 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.010301 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.010511 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.010645 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.010818 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.010962 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.011127 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.011254 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.011437 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.011563 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.011744 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.011879 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.012080 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.012199 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.012416 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.012543 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.012737 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.012864 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.013064 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.013191 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.013380 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.013513 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.013702 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.013839 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.014018 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.014145 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.014342 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.014487 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.014693 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.014824 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.015022 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.015150 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.015337 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.015472 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.015675 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.015802 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.015991 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.016118 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.016309 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.016449 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.016625 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.016753 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.016942 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.017069 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.017252 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.017388 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.017571 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.017705 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.017902 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.018029 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.018233 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.018367 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.018567 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.018695 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.018899 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.019027 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.019224 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.019353 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.019550 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.019677 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.019872 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.020007 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.020188 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.020323 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.020564 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.020695 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.021393 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.021537 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.021740 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.021874 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.022023 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.022160 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.022342 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.022528 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.022686 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.022814 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.023010 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.023136 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.023332 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.023467 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.023663 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.023792 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.023994 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.024131 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.024326 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.024462 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.024655 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.024782 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.025006 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.025133 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.025323 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.025451 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.025672 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.025800 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.026003 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.026130 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.026363 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.026520 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.026649 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.026784 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.026966 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.027095 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:47:21.027229 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 19:47:21.027360 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 19:47:21.050352 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG oslo_db.sqlalchemy.engines [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:47:21.052412 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:47:21.114040 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.context [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8204c3b4-68ac-47e6-ab11-d602a48c1ae1(cell1) {{(pid=102582) load_cells /opt/stack/nova/nova/context.py:464}} May 10 19:47:21.116115 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.context [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8204c3b4-68ac-47e6-ab11-d602a48c1ae1(cell1) {{(pid=102581) load_cells /opt/stack/nova/nova/context.py:464}} May 10 19:47:21.119228 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG oslo_concurrency.lockutils [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:47:21.120699 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:47:21.120793 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG oslo_concurrency.lockutils [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:47:21.121592 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG oslo_concurrency.lockutils [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:47:21.122275 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:47:21.123091 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:47:21.123566 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG oslo_concurrency.lockutils [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:47:21.125022 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:47:21.135526 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG oslo_db.sqlalchemy.engines [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:47:21.139209 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG oslo_db.sqlalchemy.engines [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:47:21.142263 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:47:21.145689 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:47:21.307470 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG oslo_db.sqlalchemy.engines [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:47:21.314265 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_db.sqlalchemy.engines [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:47:21.650168 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 19:47:21.653906 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: WARNING keystonemiddleware.auth_token [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 19:47:21.657498 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 19:47:21.661754 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: WARNING keystonemiddleware.auth_token [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 19:47:22.003042 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 19:47:22.009805 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: WARNING keystonemiddleware.auth_token [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 19:47:22.010180 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: WARNING keystonemiddleware.auth_token [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 19:47:22.015908 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: WARNING keystonemiddleware.auth_token [None req-a736fb67-9cfe-48de-82e2-33819ee549d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 19:47:22.016028 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56100f4459c0 pid: 102581 (default app) May 10 19:47:22.018083 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:47:22.019304 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001768 May 10 19:47:22.019723 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Tue May 10 19:47:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:47:22.021993 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56100f4459c0 pid: 102582 (default app) May 10 19:48:39.636928 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:48:39.637950 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 10 19:48:39.638339 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:48:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:48:40.065233 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-b8f1f3df-49e4-4630-acd3-7206b7aad55e admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:48:40.095903 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-b8f1f3df-49e4-4630-acd3-7206b7aad55e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.450967 May 10 19:48:40.096737 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Tue May 10 19:48:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:48:42.379302 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:48:42.380931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-12eb9add-8b90-4b7e-abb4-1724f3e03f77 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002502 May 10 19:48:42.382539 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:48:42.445862 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-dfee43df-42fd-42cf-8452-9a7b451ef511 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:42.464414 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:48:42.464414 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: warnings.warn(msg) May 10 19:48:42.493437 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-dfee43df-42fd-42cf-8452-9a7b451ef511 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103662 May 10 19:48:42.494597 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 19:48:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:48:42.727298 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-37cae3e0-1023-4a69-a441-7b4599d3af6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:42.729827 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:48:42.729827 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: warnings.warn(msg) May 10 19:48:42.778275 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-37cae3e0-1023-4a69-a441-7b4599d3af6b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.275573 May 10 19:48:42.779276 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Tue May 10 19:48:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:48:45.073815 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-dfee43df-42fd-42cf-8452-9a7b451ef511 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:48:45.075540 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-dfee43df-42fd-42cf-8452-9a7b451ef511 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002171 May 10 19:48:45.076563 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:48:45.187427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-9f9a89f5-c527-4360-8f60-f80f3a5fe5ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "id": "d1"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:45.205408 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:48:45.205408 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: warnings.warn(msg) May 10 19:48:45.223786 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-9f9a89f5-c527-4360-8f60-f80f3a5fe5ae admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139639 May 10 19:48:45.224333 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 19:48:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:48:45.236410 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-0afdeb93-4f55-4eec-aa47-f2c75713e48d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:45.238111 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:48:45.238111 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: warnings.warn(msg) May 10 19:48:45.275485 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-0afdeb93-4f55-4eec-aa47-f2c75713e48d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043181 May 10 19:48:45.276303 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Tue May 10 19:48:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:48:47.565996 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-9f9a89f5-c527-4360-8f60-f80f3a5fe5ae admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:48:47.567267 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-9f9a89f5-c527-4360-8f60-f80f3a5fe5ae admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 May 10 19:48:47.567737 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:48:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:48:47.635435 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-21f70e10-3f30-4950-b785-5c2bed4c2c3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "disk": 10, "rxtx_factor": 1.0}} {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:47.653516 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-21f70e10-3f30-4950-b785-5c2bed4c2c3b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079888 May 10 19:48:47.654064 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 19:48:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:48:47.667682 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-3e82b042-3ca2-4c29-892c-46bacca025e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:47.690962 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-3e82b042-3ca2-4c29-892c-46bacca025e8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027463 May 10 19:48:47.691633 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Tue May 10 19:48:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:48:50.031088 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-21f70e10-3f30-4950-b785-5c2bed4c2c3b admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:48:50.032186 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-21f70e10-3f30-4950-b785-5c2bed4c2c3b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 May 10 19:48:50.032807 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:48:50.095403 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-d8be87b8-fbdd-4425-8780-5550505928d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "disk": 10, "id": "d3", "ram": 2048}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:50.113902 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-d8be87b8-fbdd-4425-8780-5550505928d9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074940 May 10 19:48:50.114512 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 19:48:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:48:50.127140 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-b6fa78f5-1a68-4849-b7ac-5c3da364f7ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:50.150194 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-b6fa78f5-1a68-4849-b7ac-5c3da364f7ef admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027406 May 10 19:48:50.150864 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Tue May 10 19:48:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:48:52.462845 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-d8be87b8-fbdd-4425-8780-5550505928d9 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:48:52.463866 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-d8be87b8-fbdd-4425-8780-5550505928d9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 10 19:48:52.464285 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:48:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:48:52.532002 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-449a6a60-78d4-467b-83b6-378f3d926c28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "name": "ds4G", "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:52.558908 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-449a6a60-78d4-467b-83b6-378f3d926c28 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088110 May 10 19:48:52.559719 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 19:48:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:48:52.571670 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-ed6cf4b5-527d-4334-9912-bbd29249faa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:52.594884 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-ed6cf4b5-527d-4334-9912-bbd29249faa0 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026927 May 10 19:48:52.595443 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Tue May 10 19:48:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:48:54.872695 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-449a6a60-78d4-467b-83b6-378f3d926c28 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:48:54.873716 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-449a6a60-78d4-467b-83b6-378f3d926c28 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 10 19:48:54.874119 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:48:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:48:54.937977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-e871da3f-b03d-4c17-872d-71d5f7772a6c admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:48:54.965561 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-e871da3f-b03d-4c17-872d-71d5f7772a6c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084713 May 10 19:48:54.966342 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Tue May 10 19:48:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:48:57.270802 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-449a6a60-78d4-467b-83b6-378f3d926c28 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:48:57.271811 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-449a6a60-78d4-467b-83b6-378f3d926c28 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 May 10 19:48:57.272220 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:48:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 19:48:57.340499 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-10bfc76d-b206-4591-881a-227b649f310d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:57.358903 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-10bfc76d-b206-4591-881a-227b649f310d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080850 May 10 19:48:57.359447 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 19:48:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:48:57.372097 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-a02c4385-e031-4e96-bc59-1e8f8b7eeffc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:48:57.398021 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-a02c4385-e031-4e96-bc59-1e8f8b7eeffc admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029409 May 10 19:48:57.399219 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Tue May 10 19:48:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:49:00.285867 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-10bfc76d-b206-4591-881a-227b649f310d admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:00.286907 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-10bfc76d-b206-4591-881a-227b649f310d admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 10 19:49:00.287312 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:49:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:00.347941 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-6630a061-75bc-4eb3-b9ef-729b3f33d4e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "id": "2", "vcpus": 1, "disk": 20, "swap": 0}} {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:00.365834 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-6630a061-75bc-4eb3-b9ef-729b3f33d4e9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072484 May 10 19:49:00.366405 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 19:49:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:49:00.379271 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-89e4e579-ac6f-4a30-a5e5-f1fad57cd214 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:00.402619 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-89e4e579-ac6f-4a30-a5e5-f1fad57cd214 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027727 May 10 19:49:00.403193 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Tue May 10 19:49:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:49:02.684938 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-6630a061-75bc-4eb3-b9ef-729b3f33d4e9 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:02.686046 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-6630a061-75bc-4eb3-b9ef-729b3f33d4e9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 10 19:49:02.686474 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:49:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:02.745817 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-da373b92-9479-4025-a154-640dfa42ab4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "ram": 4096}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:02.763420 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-da373b92-9479-4025-a154-640dfa42ab4c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070655 May 10 19:49:02.763971 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 19:49:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 19:49:02.775610 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-01969762-bfdf-4c8f-ad59-d9d5d819c6fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:02.797462 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-01969762-bfdf-4c8f-ad59-d9d5d819c6fc admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025434 May 10 19:49:02.797969 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Tue May 10 19:49:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:49:05.064403 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-da373b92-9479-4025-a154-640dfa42ab4c admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:05.065227 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-da373b92-9479-4025-a154-640dfa42ab4c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001948 May 10 19:49:05.065594 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:49:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:05.127328 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-e97d143b-b719-4b0e-89fb-b9421c7d8f08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "disk": 80, "ram": 8192}} {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:05.146001 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-e97d143b-b719-4b0e-89fb-b9421c7d8f08 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074597 May 10 19:49:05.146575 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 19:49:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:49:05.159798 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-7918a5ee-b5ef-4e19-92f5-2af7fffd4161 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:05.190809 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-7918a5ee-b5ef-4e19-92f5-2af7fffd4161 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036218 May 10 19:49:05.198982 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Tue May 10 19:49:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:49:07.536536 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-e97d143b-b719-4b0e-89fb-b9421c7d8f08 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:07.537554 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-e97d143b-b719-4b0e-89fb-b9421c7d8f08 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 10 19:49:07.538166 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:49:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:07.608810 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-226c2f27-59e2-48f2-848b-ed6ab07f161d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "swap": 0}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:07.628988 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-226c2f27-59e2-48f2-848b-ed6ab07f161d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.083943 May 10 19:49:07.629543 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 19:49:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:49:07.641451 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-00ab52b2-efe1-40ae-bc47-739441390c80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:07.666814 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-00ab52b2-efe1-40ae-bc47-739441390c80 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029066 May 10 19:49:07.667800 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Tue May 10 19:49:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:49:31.535322 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-226c2f27-59e2-48f2-848b-ed6ab07f161d admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:31.536337 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-226c2f27-59e2-48f2-848b-ed6ab07f161d admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 10 19:49:31.536737 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:49:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:31.592787 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-ab850599-a661-4a4f-8637-ef25a99ffa94 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:31.611054 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-ab850599-a661-4a4f-8637-ef25a99ffa94 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068252 May 10 19:49:31.611622 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Tue May 10 19:49:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:49:32.621950 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-226c2f27-59e2-48f2-848b-ed6ab07f161d admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:32.623015 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-226c2f27-59e2-48f2-848b-ed6ab07f161d admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 10 19:49:32.623408 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:49:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:32.820842 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-7f800ccb-d068-4e78-bac8-2b6e5d749b9b admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:32.826506 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.wsgi [None req-7f800ccb-d068-4e78-bac8-2b6e5d749b9b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-7f800ccb-d068-4e78-bac8-2b6e5d749b9b admin admin] Request method failure captured: May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Accept: application/json May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Accept-Encoding: gzip, deflate May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Connection: keep-alive May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Content-Length: 0 May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Host: 10.222.0.57 May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Openstack-Api-Version: compute 2.90 May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Openstack-System-Scope: None May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: User-Agent: python-novaclient May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Auth-Token: gAAAAABiesHM2LoLzyXThzv5hcwfSk9sBmSdrHPPSRotqiJCEe0LcPOqDYKwRqFTjG0rnNvzJJPbMW09iPyeB51MlZAxNZv3Z0Ziw5pRnwu7gwZ4YsYl4478nhGAxH_fhrF4pz1kkzK_DC_Qh05OnIvhgLZV4s1Vsu7gdjRu7ZOtJ97NaQpr9R0 May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Domain-Id: None May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Domain-Name: None May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Identity-Status: Confirmed May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Is-Admin-Project: True May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Openstack-Nova-Api-Version: 2.90 May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Domain-Id: default May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Domain-Name: Default May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Name: admin May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Role: member,admin,reader May 10 19:49:32.829776 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Roles: member,admin,reader May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00ba0ca569547899fe0f1c352883756", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00ba0ca569547899fe0f1c352883756"}]}] May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Tenant: admin May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Tenant-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Tenant-Name: admin May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User: admin May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Domain-Id: default May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Domain-Name: Default May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Id: 88a33ed416d14d68b26b32e116862838 May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Name: admin May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: method: > May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: exception: Flavor 42 could not be found. May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: action_args: {'id': '42'} May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:49:32.831949 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:32.832870 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:32.834050 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-7f800ccb-d068-4e78-bac8-2b6e5d749b9b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:49:32.835165 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-7f800ccb-d068-4e78-bac8-2b6e5d749b9b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061574 May 10 19:49:32.835165 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Tue May 10 19:49:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 19:49:32.842082 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-43e44925-46ef-4847-b7cb-b3f9ba9ba9e2 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:32.862255 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-43e44925-46ef-4847-b7cb-b3f9ba9ba9e2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023743 May 10 19:49:32.862811 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 19:49:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:49:32.872490 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-61140797-1b6a-483d-a1b9-253b85440558 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:32.894647 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-61140797-1b6a-483d-a1b9-253b85440558 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025902 May 10 19:49:32.895201 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 19:49:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:49:32.904203 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-4fd4177f-b540-4631-a4ab-f88d4b7588e3 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:32.910195 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.wsgi [None req-4fd4177f-b540-4631-a4ab-f88d4b7588e3 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-4fd4177f-b540-4631-a4ab-f88d4b7588e3 admin admin] Request method failure captured: May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Accept: application/json May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Accept-Encoding: gzip, deflate May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Connection: keep-alive May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Content-Length: 0 May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Host: 10.222.0.57 May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Openstack-Api-Version: compute 2.90 May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Openstack-System-Scope: None May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: User-Agent: python-novaclient May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Auth-Token: gAAAAABiesHM2LoLzyXThzv5hcwfSk9sBmSdrHPPSRotqiJCEe0LcPOqDYKwRqFTjG0rnNvzJJPbMW09iPyeB51MlZAxNZv3Z0Ziw5pRnwu7gwZ4YsYl4478nhGAxH_fhrF4pz1kkzK_DC_Qh05OnIvhgLZV4s1Vsu7gdjRu7ZOtJ97NaQpr9R0 May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Domain-Id: None May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Domain-Name: None May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Identity-Status: Confirmed May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Is-Admin-Project: True May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Openstack-Nova-Api-Version: 2.90 May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Domain-Id: default May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Domain-Name: Default May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Name: admin May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Role: member,admin,reader May 10 19:49:32.913417 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Roles: member,admin,reader May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00ba0ca569547899fe0f1c352883756", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00ba0ca569547899fe0f1c352883756"}]}] May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Tenant: admin May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Tenant-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Tenant-Name: admin May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User: admin May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Domain-Id: default May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Domain-Name: Default May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Id: 88a33ed416d14d68b26b32e116862838 May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Name: admin May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: method: > May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: exception: Flavor 42 could not be found. May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: action_args: {'id': '42'} May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:49:32.914972 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:32.915931 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:32.917400 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-4fd4177f-b540-4631-a4ab-f88d4b7588e3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:49:32.918674 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-4fd4177f-b540-4631-a4ab-f88d4b7588e3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014076 May 10 19:49:32.918674 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Tue May 10 19:49:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 19:49:33.813434 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-61140797-1b6a-483d-a1b9-253b85440558 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:33.814485 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-61140797-1b6a-483d-a1b9-253b85440558 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 10 19:49:33.815431 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:49:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:34.011134 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-b8f33147-d8c4-4222-bf29-1b90d79b47d3 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:34.016373 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.wsgi [None req-b8f33147-d8c4-4222-bf29-1b90d79b47d3 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-b8f33147-d8c4-4222-bf29-1b90d79b47d3 admin admin] Request method failure captured: May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Accept: application/json May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Accept-Encoding: gzip, deflate May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Connection: keep-alive May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Content-Length: 0 May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Host: 10.222.0.57 May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Openstack-Api-Version: compute 2.90 May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Openstack-System-Scope: None May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: User-Agent: python-novaclient May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Auth-Token: gAAAAABiesHNkZdl6kXY7j1zAx7V1AAph0f3ZeUV54150ZxyKhFyciyKbELhtWww4pgfc27ZEBroQ9UN4phTkCClWuBBrSlZ58byR-hQ0i5G-ci5-xHGR7nM6QWHA1BysPyPVvk4ZggslBNbNITmfpZf5f_2s81S21r_JE2GXqaXtSY5rAUphcE May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Domain-Id: None May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Domain-Name: None May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Identity-Status: Confirmed May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Is-Admin-Project: True May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Openstack-Nova-Api-Version: 2.90 May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Domain-Id: default May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Domain-Name: Default May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Name: admin May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Role: member,admin,reader May 10 19:49:34.018386 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Roles: member,admin,reader May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00ba0ca569547899fe0f1c352883756", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00ba0ca569547899fe0f1c352883756"}]}] May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Tenant: admin May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Tenant-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Tenant-Name: admin May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User: admin May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Domain-Id: default May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Domain-Name: Default May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Id: 88a33ed416d14d68b26b32e116862838 May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Name: admin May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: method: > May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: exception: Flavor 84 could not be found. May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: action_args: {'id': '84'} May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:49:34.019977 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:34.020925 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:34.022234 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-b8f33147-d8c4-4222-bf29-1b90d79b47d3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:49:34.023667 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-b8f33147-d8c4-4222-bf29-1b90d79b47d3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065949 May 10 19:49:34.023667 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Tue May 10 19:49:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 19:49:34.029467 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-70b07e29-bbf5-42ba-ac2f-040bf5d5d955 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:34.043605 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-70b07e29-bbf5-42ba-ac2f-040bf5d5d955 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017648 May 10 19:49:34.044072 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 19:49:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:49:34.053104 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-0f4ea0fb-75b2-4ea2-896d-5fdaa79062f5 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:34.066724 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-0f4ea0fb-75b2-4ea2-896d-5fdaa79062f5 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017054 May 10 19:49:34.067245 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 19:49:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:49:34.076275 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-4633e915-07b9-40af-a521-ab53bc0333b4 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:34.081996 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.wsgi [None req-4633e915-07b9-40af-a521-ab53bc0333b4 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-4633e915-07b9-40af-a521-ab53bc0333b4 admin admin] Request method failure captured: May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Accept: application/json May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Accept-Encoding: gzip, deflate May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Connection: keep-alive May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Content-Length: 0 May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Host: 10.222.0.57 May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Openstack-Api-Version: compute 2.90 May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Openstack-System-Scope: None May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: User-Agent: python-novaclient May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Auth-Token: gAAAAABiesHNkZdl6kXY7j1zAx7V1AAph0f3ZeUV54150ZxyKhFyciyKbELhtWww4pgfc27ZEBroQ9UN4phTkCClWuBBrSlZ58byR-hQ0i5G-ci5-xHGR7nM6QWHA1BysPyPVvk4ZggslBNbNITmfpZf5f_2s81S21r_JE2GXqaXtSY5rAUphcE May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Domain-Id: None May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Domain-Name: None May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Identity-Status: Confirmed May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Is-Admin-Project: True May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Openstack-Nova-Api-Version: 2.90 May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Domain-Id: default May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Domain-Name: Default May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Name: admin May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Role: member,admin,reader May 10 19:49:34.083539 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Roles: member,admin,reader May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00ba0ca569547899fe0f1c352883756", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00ba0ca569547899fe0f1c352883756"}]}] May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Tenant: admin May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Tenant-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Tenant-Name: admin May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User: admin May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Domain-Id: default May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Domain-Name: Default May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Id: 88a33ed416d14d68b26b32e116862838 May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Name: admin May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: method: > May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: exception: Flavor 84 could not be found. May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: action_args: {'id': '84'} May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:49:34.085037 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:34.085889 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:34.087025 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-4633e915-07b9-40af-a521-ab53bc0333b4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:49:34.088035 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-4633e915-07b9-40af-a521-ab53bc0333b4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012095 May 10 19:49:34.088035 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Tue May 10 19:49:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 19:49:34.982771 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-0f4ea0fb-75b2-4ea2-896d-5fdaa79062f5 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:34.983775 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-0f4ea0fb-75b2-4ea2-896d-5fdaa79062f5 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 10 19:49:34.984180 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:35.173546 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-a1a6a0b7-f640-405a-b800-5a720b70a6e2 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:35.179231 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.wsgi [None req-a1a6a0b7-f640-405a-b800-5a720b70a6e2 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-a1a6a0b7-f640-405a-b800-5a720b70a6e2 admin admin] Request method failure captured: May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Accept: application/json May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Accept-Encoding: gzip, deflate May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Connection: keep-alive May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Content-Length: 0 May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Host: 10.222.0.57 May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Openstack-Api-Version: compute 2.90 May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Openstack-System-Scope: None May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: User-Agent: python-novaclient May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Auth-Token: gAAAAABiesHOKv1rfoPmKWKkmaxQSlhRF_UkCZdaizlTaqQ0tW8LFUippfVj6hXXPMN1lu6mkqFE3w_usT8UGBHyB7Nuw7TelYav5Wu9Npp3Ho945AppDYzwzkeb2KGmTFLpd4nLYGEWeK2zOiiTvfAJfUYi1DuASbyv8gmA_Vmc_25fNHtnPKs May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Domain-Id: None May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Domain-Name: None May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Identity-Status: Confirmed May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Is-Admin-Project: True May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Openstack-Nova-Api-Version: 2.90 May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Domain-Id: default May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Domain-Name: Default May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Project-Name: admin May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Role: member,admin,reader May 10 19:49:35.180724 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Roles: member,admin,reader May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00ba0ca569547899fe0f1c352883756", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00ba0ca569547899fe0f1c352883756"}]}] May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Tenant: admin May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Tenant-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-Tenant-Name: admin May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User: admin May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Domain-Id: default May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Domain-Name: Default May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Id: 88a33ed416d14d68b26b32e116862838 May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: X-User-Name: admin May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: method: > May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: exception: Flavor 451 could not be found. May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: action_args: {'id': '451'} May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:49:35.182168 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:35.183032 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: ERROR nova.api.openstack.wsgi May 10 19:49:35.184122 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-a1a6a0b7-f640-405a-b800-5a720b70a6e2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:49:35.185159 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-a1a6a0b7-f640-405a-b800-5a720b70a6e2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060639 May 10 19:49:35.185159 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 19:49:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 19:49:35.192507 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-030fa54c-eb63-4da4-9ef5-9527516dd160 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:35.206427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-030fa54c-eb63-4da4-9ef5-9527516dd160 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018021 May 10 19:49:35.206978 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 19:49:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:49:35.216173 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:35.229522 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016817 May 10 19:49:35.230049 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 19:49:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:49:35.238954 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-37a10483-2273-4f15-8894-a71fab43be7b admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:35.244100 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.wsgi [None req-37a10483-2273-4f15-8894-a71fab43be7b admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-37a10483-2273-4f15-8894-a71fab43be7b admin admin] Request method failure captured: May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Accept: application/json May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Accept-Encoding: gzip, deflate May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Connection: keep-alive May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Content-Length: 0 May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Host: 10.222.0.57 May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Openstack-Api-Version: compute 2.90 May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Openstack-System-Scope: None May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: User-Agent: python-novaclient May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Auth-Token: gAAAAABiesHOKv1rfoPmKWKkmaxQSlhRF_UkCZdaizlTaqQ0tW8LFUippfVj6hXXPMN1lu6mkqFE3w_usT8UGBHyB7Nuw7TelYav5Wu9Npp3Ho945AppDYzwzkeb2KGmTFLpd4nLYGEWeK2zOiiTvfAJfUYi1DuASbyv8gmA_Vmc_25fNHtnPKs May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Domain-Id: None May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Domain-Name: None May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Identity-Status: Confirmed May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Is-Admin-Project: True May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Openstack-Nova-Api-Version: 2.90 May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Domain-Id: default May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Domain-Name: Default May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Project-Name: admin May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Role: member,admin,reader May 10 19:49:35.245846 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Roles: member,admin,reader May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00ba0ca569547899fe0f1c352883756", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00ba0ca569547899fe0f1c352883756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00ba0ca569547899fe0f1c352883756"}]}] May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Tenant: admin May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Tenant-Id: f00ba0ca569547899fe0f1c352883756 May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-Tenant-Name: admin May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User: admin May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Domain-Id: default May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Domain-Name: Default May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Id: 88a33ed416d14d68b26b32e116862838 May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: X-User-Name: admin May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: method: > May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: exception: Flavor 451 could not be found. May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: action_args: {'id': '451'} May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:49:35.247428 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:35.248387 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: ERROR nova.api.openstack.wsgi May 10 19:49:35.249427 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-37a10483-2273-4f15-8894-a71fab43be7b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:49:35.250434 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-37a10483-2273-4f15-8894-a71fab43be7b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011754 May 10 19:49:35.250434 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 19:49:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 19:49:36.141727 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:36.142771 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 10 19:49:36.143174 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:49:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:36.332905 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-050734fa-abcb-4966-b228-5b07b9bb0773 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:36.350545 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-050734fa-abcb-4966-b228-5b07b9bb0773 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069079 May 10 19:49:36.351022 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Tue May 10 19:49:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 19:49:37.234918 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:37.235920 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 10 19:49:37.236318 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:49:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:37.429827 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-4e50614f-cd49-49b6-8d95-62d743b59ac6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:37.447145 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-4e50614f-cd49-49b6-8d95-62d743b59ac6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074682 May 10 19:49:37.447692 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Tue May 10 19:49:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:49:38.404366 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:38.405360 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 10 19:49:38.405760 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:38.593501 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-78ee6fea-0bdd-4284-b2b9-5d534de3c829 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:38.610644 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-78ee6fea-0bdd-4284-b2b9-5d534de3c829 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068943 May 10 19:49:38.611186 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Tue May 10 19:49:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:49:39.489505 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:39.490529 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 May 10 19:49:39.490924 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:49:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:39.676843 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-82e35d35-2d36-4b93-96ae-198fa576fd1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:49:39.694847 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-82e35d35-2d36-4b93-96ae-198fa576fd1c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068840 May 10 19:49:39.695392 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Tue May 10 19:49:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:49:40.576782 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:40.577777 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 10 19:49:40.578174 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:49:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:49:40.770756 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-95582c84-94a6-4d3e-a962-344a33b2c5d8 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:49:40.789388 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-95582c84-94a6-4d3e-a962-344a33b2c5d8 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075492 May 10 19:49:40.789835 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Tue May 10 19:49:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:50:42.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:50:42.859547 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-3657ae3c-edb3-4534-8336-1d12fadc2e2a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 10 19:50:42.859947 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 19:50:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:50:42.917784 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-4635d735-3867-440f-9f83-f380ee96a21f admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:50:42.936688 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-4635d735-3867-440f-9f83-f380ee96a21f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070823 May 10 19:50:42.937211 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Tue May 10 19:50:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:50:42.960494 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-0c222e19-05e9-491f-88bb-bb81d52cb1bf admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:50:42.968026 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-0c222e19-05e9-491f-88bb-bb81d52cb1bf admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012315 May 10 19:50:42.968549 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Tue May 10 19:50:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:50:42.980220 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-cbfd9443-f2b2-4013-89cf-7bf970c39fb2 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:50:42.987664 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-cbfd9443-f2b2-4013-89cf-7bf970c39fb2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010912 May 10 19:50:42.988169 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Tue May 10 19:50:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:50:42.998940 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-f8c09255-7115-411c-aa1e-b2f887326b16 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:50:43.006209 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-f8c09255-7115-411c-aa1e-b2f887326b16 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010888 May 10 19:50:43.006767 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Tue May 10 19:50:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:50:43.017275 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-d6b95c7b-afea-4d4b-956f-273414321c9c admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:50:43.025120 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-d6b95c7b-afea-4d4b-956f-273414321c9c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011206 May 10 19:50:43.025630 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Tue May 10 19:50:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:54:06.163012 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-f8c09255-7115-411c-aa1e-b2f887326b16 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:54:06.163962 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-f8c09255-7115-411c-aa1e-b2f887326b16 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 10 19:54:06.164361 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:54:06.433916 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-113f06a8-b0e6-4f8f-8f7b-ff4969528de3 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:54:06.435140 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:54:06.435140 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: warnings.warn(msg) May 10 19:54:06.436334 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-113f06a8-b0e6-4f8f-8f7b-ff4969528de3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:54:06.436787 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-113f06a8-b0e6-4f8f-8f7b-ff4969528de3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:54:06.437596 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-113f06a8-b0e6-4f8f-8f7b-ff4969528de3 admin admin] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:54:06.438022 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-113f06a8-b0e6-4f8f-8f7b-ff4969528de3 admin admin] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:54:06.470617 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-113f06a8-b0e6-4f8f-8f7b-ff4969528de3 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149904 May 10 19:54:06.471176 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 19:54:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:54:07.371380 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-f8c09255-7115-411c-aa1e-b2f887326b16 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:54:07.372412 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-f8c09255-7115-411c-aa1e-b2f887326b16 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 10 19:54:07.372811 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:54:07.560873 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-f4e9b585-32d4-461d-80ef-56e466385968 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:54:07.562050 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:54:07.562050 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: warnings.warn(msg) May 10 19:54:07.563280 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-f4e9b585-32d4-461d-80ef-56e466385968 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:54:07.563721 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-f4e9b585-32d4-461d-80ef-56e466385968 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:54:07.564508 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-f4e9b585-32d4-461d-80ef-56e466385968 admin admin] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:54:07.564963 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-f4e9b585-32d4-461d-80ef-56e466385968 admin admin] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:54:07.583985 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-f4e9b585-32d4-461d-80ef-56e466385968 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074171 May 10 19:54:07.584473 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 19:54:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 19:54:18.898748 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-f8c09255-7115-411c-aa1e-b2f887326b16 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:54:18.899756 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-f8c09255-7115-411c-aa1e-b2f887326b16 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 10 19:54:18.900160 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:54:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:54:19.086600 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-25a9f738-a615-4d2f-bbb6-2eeb12ed47f8 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:54:19.087804 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:54:19.087804 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: warnings.warn(msg) May 10 19:54:19.089020 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-25a9f738-a615-4d2f-bbb6-2eeb12ed47f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:54:19.089458 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-25a9f738-a615-4d2f-bbb6-2eeb12ed47f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:54:19.090238 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-25a9f738-a615-4d2f-bbb6-2eeb12ed47f8 admin admin] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:54:19.090694 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-25a9f738-a615-4d2f-bbb6-2eeb12ed47f8 admin admin] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:54:19.116802 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-25a9f738-a615-4d2f-bbb6-2eeb12ed47f8 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080661 May 10 19:54:19.117355 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 19:54:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:54:20.023247 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: DEBUG nova.api.openstack.wsgi [None req-f8c09255-7115-411c-aa1e-b2f887326b16 admin admin] Calling method '>' {{(pid=102582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:54:20.024280 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: INFO nova.api.openstack.requestlog [None req-f8c09255-7115-411c-aa1e-b2f887326b16 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 10 19:54:20.024680 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: [pid: 102582|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 19:54:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:54:20.214050 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG nova.api.openstack.wsgi [None req-53ec6d2b-1ab8-4604-a7e9-d18c6084cbe1 admin admin] Calling method '>' {{(pid=102581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:54:20.215325 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:54:20.215325 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: warnings.warn(msg) May 10 19:54:20.216531 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-53ec6d2b-1ab8-4604-a7e9-d18c6084cbe1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:54:20.216973 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-53ec6d2b-1ab8-4604-a7e9-d18c6084cbe1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:54:20.217782 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-53ec6d2b-1ab8-4604-a7e9-d18c6084cbe1 admin admin] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:54:20.218206 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: DEBUG oslo_concurrency.lockutils [None req-53ec6d2b-1ab8-4604-a7e9-d18c6084cbe1 admin admin] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:54:20.239557 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: INFO nova.api.openstack.requestlog [None req-53ec6d2b-1ab8-4604-a7e9-d18c6084cbe1 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076245 May 10 19:54:20.240100 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: [pid: 102581|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 19:54:20 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 19:55:20.992422 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: Tue May 10 19:55:20 2022 - graceful shutdown triggered... May 10 19:55:20.992912 dv-cinder-841315-1-iscsi devstack@n-api.service[102581]: Gracefully killing worker 1 (pid: 102581)... May 10 19:55:20.992550 dv-cinder-841315-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 19:55:20.993679 dv-cinder-841315-1-iscsi devstack@n-api.service[102582]: Gracefully killing worker 2 (pid: 102582)... May 10 19:55:21.993545 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: worker 1 buried after 1 seconds May 10 19:55:21.993942 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: worker 2 buried after 1 seconds May 10 19:55:21.993942 dv-cinder-841315-1-iscsi devstack@n-api.service[102580]: goodbye to uWSGI. May 10 19:55:21.995167 dv-cinder-841315-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 19:55:21.995755 dv-cinder-841315-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 19:55:21.998421 dv-cinder-841315-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 19:55:22.012883 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 19:55:22.030673 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 19:55:22 2022] *** May 10 19:55:22.030673 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 19:55:22.030673 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 19:55:22.030673 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: nodename: dv-cinder-841315-1-iscsi May 10 19:55:22.030673 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: machine: x86_64 May 10 19:55:22.030673 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: clock source: unix May 10 19:55:22.030673 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: pcre jit disabled May 10 19:55:22.030673 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: detected number of CPU cores: 4 May 10 19:55:22.030673 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: current working directory: / May 10 19:55:22.030673 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: detected binary path: /usr/bin/uwsgi-core May 10 19:55:22.031461 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: your processes number limit is 47680 May 10 19:55:22.031461 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: your memory page size is 4096 bytes May 10 19:55:22.031461 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: detected max file descriptor number: 2048 May 10 19:55:22.031461 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: lock engine: pthread robust mutexes May 10 19:55:22.031461 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: thunder lock: enabled May 10 19:55:22.031461 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 19:55:22.031461 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 19:55:22.077984 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: Python main interpreter initialized at 0x560dffbc69c0 May 10 19:55:22.077984 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: python threads support enabled May 10 19:55:22.077984 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: your server socket listen backlog is limited to 100 connections May 10 19:55:22.077984 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: your mercy for graceful operations on workers is 90 seconds May 10 19:55:22.078398 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: mapped 403077 bytes (393 KB) for 2 cores May 10 19:55:22.078398 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: *** Operational MODE: preforking *** May 10 19:55:22.078707 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: *** uWSGI is running in multiple interpreter mode *** May 10 19:55:22.078707 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: spawned uWSGI master process (pid: 117109) May 10 19:55:22.078913 dv-cinder-841315-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 19:55:22.080983 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: spawned uWSGI worker 1 (pid: 117124, cores: 1) May 10 19:55:22.080983 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: spawned uWSGI worker 2 (pid: 117125, cores: 1) May 10 19:55:22.080983 dv-cinder-841315-1-iscsi devstack@n-api.service[117109]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 19:55:23.303765 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 19:55:23.304847 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 19:55:24.123825 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:55:24.123825 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: from cryptography.utils import int_from_bytes May 10 19:55:24.124173 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:55:24.124173 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: from cryptography.utils import int_from_bytes May 10 19:55:24.124315 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:55:24.124315 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: from cryptography.utils import int_from_bytes May 10 19:55:24.124438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:55:24.124438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: from cryptography.utils import int_from_bytes May 10 19:55:26.572067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 19:55:26.572736 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 19:55:26.572830 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 19:55:26.573161 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 19:55:26.573429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 19:55:26.573831 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.574172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.574545 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.574883 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.575228 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.575554 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.575891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.576227 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.576568 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.576840 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.577168 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.577511 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841315-1-iscsi {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.577843 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.578166 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.578504 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.578838 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.579158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.579494 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.579815 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.580326 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.581713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.581713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.581713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.582097 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.582224 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 19:55:26.582764 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.582847 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 19:55:26.582931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.583009 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 19:55:26.583084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.583344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 19:55:26.583604 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.583826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 19:55:26.584082 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.584309 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.584525 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.584741 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.584966 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841315-1-iscsi {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.585185 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.585421 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.585630 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.585852 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.586084 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.586306 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.586524 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.586772 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.586993 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.587207 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.587430 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.587667 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.587885 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.588104 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.588289 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.588511 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.588704 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.588878 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.589033 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841315-1-iscsi {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.589216 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.589370 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.589370 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.589654 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.589809 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.589987 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.590156 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.590312 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.590481 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.590673 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.590840 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.590996 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.591145 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.591321 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.591321 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.591621 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.591788 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.591946 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.592100 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.592249 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.592407 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.592558 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.593549 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.593719 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.593902 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.594086 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.594260 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.594413 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.594590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.594750 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.594904 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.595064 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.595216 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.595384 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.595535 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.595687 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.595841 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.595841 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.596216 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841315-1-iscsi {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.596371 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.596523 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.596677 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.596842 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.596998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.597148 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.597300 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.597462 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.597616 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.597770 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.597912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.598054 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.598197 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.598338 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.598516 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.598673 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.598827 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.598975 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.599126 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.599281 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.599433 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.599433 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.599764 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.599915 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.600064 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.600220 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.600376 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.600531 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.600680 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.601365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.601517 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.601669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.601822 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.601983 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.602127 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.602279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.602279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.602279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.602759 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.602929 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.603884 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.603884 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.604182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.604343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.604489 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.604654 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.604807 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.604961 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.605103 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.605103 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.605387 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.605387 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.605685 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.605838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.605992 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.605992 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.606297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.606448 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.606666 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.606820 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.607143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.607291 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.607441 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.607586 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.607736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.607895 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.608039 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.608188 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.608341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.608510 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.608662 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.608814 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.608963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.609112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.609255 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.609404 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.609557 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.609713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.609865 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.610007 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.610157 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.610307 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.610487 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.610651 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.610805 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.610954 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.610954 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.611240 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.611240 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.611533 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.611675 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.611817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.611817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.612115 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.612275 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.612425 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.612575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.612732 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.612888 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.613038 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.614102 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.614334 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.614586 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.614801 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.614952 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.615137 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.615374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.615374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.615374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.615858 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.616017 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.616220 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.616342 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.617286 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.617484 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.617702 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.617894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.618048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.618226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.618226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.618581 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.618738 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.618889 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.619033 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.619033 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.619337 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.619572 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.619731 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.619883 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.619883 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.620160 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.620312 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.620474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.620736 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.620888 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.621050 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.621204 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.621394 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.621570 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.621765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.621765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.622050 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.622193 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.622354 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.622542 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.622693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.622887 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.623048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.623216 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.623777 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.624177 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.624419 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.624851 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.625042 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.625187 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.625344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.625501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.625644 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.625806 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.625982 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.626131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.626131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.626423 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.626644 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.626790 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.626984 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.627152 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.627303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.627458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.627615 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.627765 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.627927 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.628122 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.628279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.628430 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.628655 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.628808 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.628959 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.629180 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.629339 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.629568 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.629739 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.629896 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.630047 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.630236 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.630394 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.630560 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.630718 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.630875 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.631019 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.631212 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.631397 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.631560 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.631720 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.631872 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.632023 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.632184 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.632327 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.632485 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.632629 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.632782 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.632932 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.633086 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.633273 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.633453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.633944 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.634339 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.634649 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.634802 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.634970 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.635130 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.635337 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.635502 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.635659 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.635803 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.635958 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.636113 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.636273 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.636426 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.636581 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.636731 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.636882 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.637038 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:55:26.637195 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.637349 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.637500 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.637644 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.637644 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.637928 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.637928 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.637928 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.638336 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.638498 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.638647 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.638819 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.638971 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.639123 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.639265 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.639461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.639614 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.639768 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.639768 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.640049 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.640193 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.640343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.640494 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.640648 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.640808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.640959 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.641104 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.641247 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.641398 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.641548 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.641692 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.641915 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.642061 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.642212 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.642364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.642547 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.642698 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.642868 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.643025 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.643176 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.643329 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.643525 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.643701 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.644187 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.644561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.644811 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.644977 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.644977 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.645268 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.645413 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.645571 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.645732 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.645884 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.646035 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.646178 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.646321 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.646493 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.646658 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.646810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.646954 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.647106 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.647257 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.647425 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.647624 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.647775 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.647919 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.648062 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.648204 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.648347 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.648516 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.648804 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.648968 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.649116 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.649266 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.649424 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.649586 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.649730 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.649873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.650024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.650175 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.650328 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.650515 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.650668 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.650822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.650966 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.651116 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.651268 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.651423 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.651577 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.651763 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.651908 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.652050 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.652206 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.652359 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.652509 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.652662 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.652823 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.652992 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.653145 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.653296 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.653296 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.653593 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.653737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.653890 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.654373 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.654766 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.655016 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.655177 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.655330 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.655484 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.655664 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.655824 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.655968 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.656330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.656483 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.656637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.656782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.656934 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.657078 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.657229 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.657455 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.657603 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.657746 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.657897 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.658049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.658193 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.658361 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.658536 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.658688 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.658832 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.658976 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.659126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.659279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.659434 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.659577 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.659752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.659911 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.660064 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.660217 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.660375 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.660526 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.660669 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.660821 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.660963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.661121 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.661272 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.661425 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.661568 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.661710 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.661861 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.662012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.662163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.662324 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.662530 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.662688 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.662849 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.663002 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.663147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.663914 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.664463 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.664982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.665263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.665263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.665647 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.665815 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.666005 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.666005 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.666475 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.666739 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.666925 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.667119 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.667288 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.667451 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.667603 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.667791 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.667954 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.668105 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.668267 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.668432 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.668590 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.668740 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.668932 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.669088 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.669277 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.669437 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.669588 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.669745 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.669934 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.670092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.670242 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.670411 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.670587 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.670587 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.670892 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.671083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.671276 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.671440 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.671591 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.671591 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.671884 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.672033 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.672196 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.672354 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.672514 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.672685 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.672837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.672986 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.673176 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.673367 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.673524 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.673684 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.673841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.673990 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.673990 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.675264 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.675553 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.675734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.675896 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.676063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.676215 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.676366 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.676522 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.676672 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.676830 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.676991 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.677142 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.677337 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.677505 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.677675 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.677826 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.677984 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.678135 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.678296 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.678447 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.678634 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.678793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.680025 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.680205 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.680360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.680519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.680519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.680834 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.680997 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.681156 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.681309 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.681466 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.681624 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.681784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.681935 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.682127 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.682311 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.682504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.682680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.682680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.682680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.682680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.682680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.682680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.682680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.682680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.683899 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.684054 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.684214 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.684391 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.684879 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.685930 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.686121 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.686378 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.686570 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.686978 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.687138 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.687292 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.687442 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.687602 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.687797 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.687950 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.688099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.688250 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.688413 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.688575 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.688734 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.688894 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.689053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.689212 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.689383 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.689383 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.689679 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.689829 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.689978 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.690127 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.690287 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.690515 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.690675 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.690837 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.690987 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.691146 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.691328 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.691328 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.691792 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.691958 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.692118 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.692268 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.692507 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.692686 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.692861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.693110 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.693280 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.693280 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.693593 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.693750 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.693908 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.693908 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.694361 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.694561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.695134 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.695484 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.695649 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.695949 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.695949 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.696246 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.696413 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.696678 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.696844 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.697009 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.697169 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.697326 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.697477 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.697642 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.698057 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.698211 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.698360 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.698527 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.698683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.698850 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.698993 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.699316 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.699471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.699647 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.699849 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.699958 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.700040 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.700139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.700224 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.700306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.700407 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.700491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.700581 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.700665 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.700748 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.700841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.700938 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.701024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.701115 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.701206 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.701341 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.701432 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.701530 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.701530 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.701692 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.701782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.701872 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.701956 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.702048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.702048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.702210 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.702294 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.702413 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.702594 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.702690 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.702776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.702865 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.702865 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.703025 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.703116 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.703209 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.703300 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.703391 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.703523 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.703622 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.703716 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.703801 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.703937 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.704042 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.704134 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.704228 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.704320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.704412 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.704514 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.704604 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.704699 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.704810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.705082 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.705307 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.705519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.705623 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.705710 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.705710 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.705884 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.705983 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.706069 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.706069 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.706238 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.706334 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.706428 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.706541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.706628 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.706628 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.706989 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.707084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.707084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.707254 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.707339 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.707429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.707527 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.707620 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.707711 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.707794 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.707922 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.708024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.708120 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.708213 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.708305 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.708399 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.708483 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.708574 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.708667 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.708667 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.708826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.708910 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709001 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709086 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709167 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709256 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709445 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709529 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709625 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709710 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709792 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709874 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.709999 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.710108 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.710202 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.710287 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.710370 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.710533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.710623 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.710705 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.710854 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.710952 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.711037 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.711129 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.711213 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.711305 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.711395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.711479 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.711561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.711653 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.711737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.711828 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.711911 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.712062 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.712158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.712255 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.712347 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.712431 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.712528 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.712626 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.712711 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.712808 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.712893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.712983 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.713075 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.713159 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.713254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.713346 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.713430 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.713512 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.713603 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.713731 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.713840 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.713935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.714019 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.714109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.714200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.714200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.714427 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.714543 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.714630 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.714712 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.714794 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.714930 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.715151 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.715262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.715344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.715424 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.715634 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.715741 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.715842 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.715842 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.716056 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.716056 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.716227 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.716325 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.716411 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.716501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.716585 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.716668 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.716750 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.716750 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.717595 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.717706 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.717794 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.717877 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.717959 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.718052 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.718145 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.718230 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.718313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.718395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.718508 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.718604 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.718697 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.718789 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.718873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.718955 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.719056 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.719148 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.719240 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.719330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.719422 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.719507 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.719661 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.719755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.719848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.719939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.720023 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.720299 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.720406 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.720627 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.720789 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.720943 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.721166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.721299 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.721570 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.721823 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.721948 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.722145 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.722265 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.722599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.722728 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.722841 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.722966 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.723152 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.723272 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.723466 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.723594 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.723778 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.723904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.724091 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.724223 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.724405 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.724532 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.724751 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.724878 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.725298 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.726183 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.726480 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.726610 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.726816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.727142 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.727279 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.727467 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.727615 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.727822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.727943 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.728107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.728320 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.728525 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.728663 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.728850 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.729006 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.729174 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.729364 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.729509 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.729754 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.729905 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.730046 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.730186 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.730373 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.730540 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.730720 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.730855 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.731043 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.731178 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.731357 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.731491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.731674 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.731817 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.732005 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.732147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.732320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.732463 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.732631 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.732764 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.732987 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.733123 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.733311 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.733455 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.733681 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.733815 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.733997 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.734146 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.734324 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.734523 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.734669 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.734802 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.734992 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.735140 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.735429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.735567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.735712 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.735905 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.736048 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.736188 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.736320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.736452 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.736614 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.736758 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.736949 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.737099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.737289 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.737435 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.737631 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.737753 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.737938 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.738046 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.738254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.738366 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.738611 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.738717 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.738939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.739033 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.739263 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.739356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.739592 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.739685 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.739906 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.740003 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.740224 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.740315 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.740541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.740643 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.740861 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.741040 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.741208 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.741419 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.742048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.742230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.742373 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.742584 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.742719 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.742860 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.742998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.743145 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.743277 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.743440 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.743576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.743716 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.743881 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.744027 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.744201 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.744335 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.744498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.744633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.744811 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.744961 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.745140 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.745275 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.745539 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.745683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.745849 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.746081 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.746224 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.746357 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.746531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.747209 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.747361 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.747592 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.747736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.747884 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.748132 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.748278 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.748442 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.748583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.748762 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.749027 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.749190 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.749325 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.749463 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.749841 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.749982 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.750115 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.750256 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.750396 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.750618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.750762 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.750904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.751044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.751044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.751317 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.751449 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.751588 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.751743 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.751898 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.752032 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.752172 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.752172 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.752423 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.752562 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.752703 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.752703 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.752952 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.753114 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.753251 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.753251 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.753519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.753651 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.753790 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.753931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.754063 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.754203 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.754343 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.754512 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.754645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.754789 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.754932 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.754932 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.755231 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.755365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.755644 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.755785 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.755927 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.756084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.756358 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.756497 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.756630 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.756768 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.756901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.757066 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.757200 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.757339 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.757508 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.757747 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.757883 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.758029 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.758262 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.758399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.758564 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.758707 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.758849 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.758982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.759114 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.759254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.759387 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.759519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.759661 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.759837 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.759975 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.760152 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.760322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.760456 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.760601 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.760736 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.760876 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.761008 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.761139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.761278 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.761420 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.761559 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.761760 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.761896 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.762088 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.762233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.762405 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.762565 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.762759 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.762896 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.763084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.763226 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.763395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.763529 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.763707 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.763844 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.764023 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.764166 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.764336 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.764471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.764647 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.764908 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.765051 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.765250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.765395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.765570 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.766193 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.766349 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.766599 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.766771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.766996 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.767142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.767282 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.767422 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.767564 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.767711 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.767852 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.768018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.768256 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.768478 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.768625 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.768758 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.768890 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.769022 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.769154 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.769285 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.769430 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.769564 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.769696 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.769827 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.769966 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.770109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.770242 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.770374 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.770523 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.770678 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.770893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.771051 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.771186 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.771319 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.771458 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.771593 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.771734 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.771875 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.772003 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.772163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.772302 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.772473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.773122 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.773260 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.773382 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.773495 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.773615 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.773747 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.773985 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.774124 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.774263 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.774396 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.774603 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.774738 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.774883 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.775016 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.775147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.775278 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.775410 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.775559 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.775691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.775906 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.776049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.776195 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.776437 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.776584 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.776708 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.776839 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.776969 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.777107 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.777238 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.777383 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.777517 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.777648 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.777949 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.778091 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.778248 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.778490 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.778628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.778760 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.778893 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.779040 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.779182 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.779314 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.779483 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.779620 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.779792 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.779928 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.780140 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.780276 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.780450 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.780596 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.780787 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.780930 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.781108 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.781245 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.781434 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.781586 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.781752 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.781899 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.782065 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.782205 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.782391 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.782545 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.782731 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.782879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.783049 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.783183 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.783368 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.783504 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.783692 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.783920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.784097 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.784290 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.784426 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.784621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.784757 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.784964 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.785107 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.785306 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.785449 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.785637 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.785786 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.786020 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.786161 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.786301 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.786554 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.786710 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.786877 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.787014 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.787232 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.787375 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.787554 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.787688 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.787871 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.788017 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.788205 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.788979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.789128 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.789269 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.789413 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.789546 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.789898 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.790121 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.790264 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.790450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.790608 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.790790 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.790925 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.791131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.791275 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.791454 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.791591 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.791773 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.791917 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.792092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.792237 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.792423 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.792570 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.792729 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.792872 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.793044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.793269 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.793416 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.793556 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.793699 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.793838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.793979 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.794121 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.794263 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.794402 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.794624 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.794761 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.794943 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.795089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.795264 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.795402 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.795576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.795708 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.795893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.796067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.796331 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.796469 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.796616 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.796813 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.796956 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.797097 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.797238 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.797392 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.797526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.797722 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.798064 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.798392 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.798738 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.799081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.799378 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.799910 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.800233 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.800605 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.800981 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.801237 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.801373 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.801609 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.801754 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.801984 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.802120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.802340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.802711 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.802865 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.803096 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.803289 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.803447 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.803625 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.804039 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.804191 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.804380 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.804516 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.804727 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.804886 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.805089 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.805350 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.805678 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.805813 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.806018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.806346 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.806531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.806688 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.806973 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.807237 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.807596 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.807737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.808038 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.808174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.808383 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.808683 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.808827 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.809049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.809314 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.809467 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.809703 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.809847 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.810035 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.810182 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.810367 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.810517 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.810724 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.810860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.811054 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.811198 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.811386 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.811522 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.811716 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.811851 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.812045 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.812196 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.812379 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.812523 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.812739 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.813034 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.813180 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.813397 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.813615 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.813752 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.814054 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.814189 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.814379 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.814531 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.814731 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.814865 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.815059 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.815196 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.815372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.815514 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.815686 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.815823 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.816000 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.816302 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.816468 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.816666 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.816799 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.816919 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.817125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.817261 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.817434 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.817571 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.817766 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.817902 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.818102 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.818245 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.818416 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.818617 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.818752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.818892 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.819055 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.819231 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.819450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.819574 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.819785 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.819905 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.820120 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.820217 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.820448 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.820560 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.820773 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.820875 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.821082 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.821179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.821407 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.821502 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.821725 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.821820 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.822056 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.822487 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.822598 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.822687 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.822786 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.822873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.823041 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.823145 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.823362 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.823456 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.823771 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.823920 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.824093 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.824262 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.824412 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.824590 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.824736 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.824932 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.825053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.825271 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.825365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.825587 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.825680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.825901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.826009 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.826215 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.826319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.826570 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.826677 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.826889 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.827005 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.827207 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.827320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.827518 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.827637 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.827833 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.827928 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.828145 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.828238 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.828457 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.828560 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.828772 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.828865 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.829084 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.829176 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.829397 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.829514 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.829711 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.829834 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.830025 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.830209 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.830373 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.830590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.830747 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.830892 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.831038 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.831182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.831336 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.831490 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.831669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.831819 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.832013 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.832169 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.832328 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.832481 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.832626 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.832813 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.832968 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.833133 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.833288 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.833441 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.833586 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.833738 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.833883 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.834046 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.834202 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.834349 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.834546 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.834698 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.834843 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.834999 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.835784 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.836029 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.836253 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.836520 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.836725 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.837096 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.837452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.837703 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.837703 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.838030 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.838185 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.838340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.838515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.838675 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.838821 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.838971 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.839125 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.839270 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.839426 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.839578 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.839742 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.839980 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.840216 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.840364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.840509 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.840652 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.840797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.840951 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.841097 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.841283 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.841447 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.841632 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.841805 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.841960 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.842113 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.842265 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.842409 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.842581 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.842737 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.842892 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.843052 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.843209 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.843362 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.843526 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.843679 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.843836 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.843981 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.844131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.844283 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.844428 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.844586 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.844731 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.844894 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.844894 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.845169 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.845323 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.845488 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.845643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.845795 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.845940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.846083 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.846249 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.846426 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 19:55:26.846617 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.846617 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.846617 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.846617 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.846960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.847144 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.847423 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.847731 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.848067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.848407 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.848727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.849060 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.849378 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.849704 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.850049 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.850342 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.850754 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.851597 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.851916 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.852253 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.852568 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.852887 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.853204 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.853519 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.853839 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.854154 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.854511 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.854848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.855161 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.855491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.855813 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.856140 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.856460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.856781 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.857169 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.857420 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.857738 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.858060 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.858375 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.858715 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.859035 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.859358 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.859691 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.860022 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.860353 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.860683 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.861036 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.861353 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.861705 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.862040 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.862367 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.862780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.863095 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:55:26.863342 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 19:55:26.869364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_db.sqlalchemy.engines [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:55:26.886507 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_db.sqlalchemy.engines [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:55:26.935074 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.context [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8204c3b4-68ac-47e6-ab11-d602a48c1ae1(cell1) {{(pid=117125) load_cells /opt/stack/nova/nova/context.py:464}} May 10 19:55:26.939488 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:55:26.941059 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:55:26.941875 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:55:26.943844 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:55:26.952720 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.context [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8204c3b4-68ac-47e6-ab11-d602a48c1ae1(cell1) {{(pid=117124) load_cells /opt/stack/nova/nova/context.py:464}} May 10 19:55:26.956033 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_db.sqlalchemy.engines [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:55:26.957020 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_db.sqlalchemy.engines [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:55:26.957980 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:55:26.959619 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:55:26.960987 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:55:26.962975 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:55:26.974693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_db.sqlalchemy.engines [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:55:26.976697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_db.sqlalchemy.engines [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:55:27.117091 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_db.sqlalchemy.engines [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:55:27.137257 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_db.sqlalchemy.engines [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:55:27.448497 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: WARNING keystonemiddleware.auth_token [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 19:55:27.456132 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: WARNING keystonemiddleware.auth_token [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 19:55:27.473644 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: WARNING keystonemiddleware.auth_token [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 19:55:27.481371 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: WARNING keystonemiddleware.auth_token [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 19:55:27.805355 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: WARNING keystonemiddleware.auth_token [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 19:55:27.811526 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: WARNING keystonemiddleware.auth_token [None req-11831c73-a6f2-4c95-b17c-11ecd9ed89e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 19:55:27.816852 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560dffbc69c0 pid: 117125 (default app) May 10 19:55:27.828830 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: WARNING keystonemiddleware.auth_token [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 19:55:27.835667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: WARNING keystonemiddleware.auth_token [None req-680d0d96-044d-4aa7-aad8-d9768b4f3ccd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 19:55:27.841304 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560dffbc69c0 pid: 117124 (default app) May 10 19:56:10.706620 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a17ffd43-45ee-4758-a258-9a9a781edcb5 tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] Action: 'create', calling method: .version_select at 0x7fdd3ba1c280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-61584243", "metadata": {"Type": "work"}}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:10.829160 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-92b8db14-9b4b-42b8-b91c-33f4d02f2d84 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Action: 'create', calling method: .version_select at 0x7fdd3ba1b280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1709171667"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:12.656949 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-92b8db14-9b4b-42b8-b91c-33f4d02f2d84 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.809013 May 10 19:56:12.658376 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1154 bytes} [Tue May 10 19:56:09 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2812 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 10 19:56:12.674552 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-319bf0e3-1eb3-451c-a407-b1af38bda39d tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b875280>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:12.681190 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a17ffd43-45ee-4758-a258-9a9a781edcb5 tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.974427 May 10 19:56:12.691449 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 1/2] 10.222.0.57 () {60 vars in 1155 bytes} [Tue May 10 19:56:09 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 2986 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 19:56:12.701387 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ba0cdb83-cdfb-44f6-bcc5-1b2fb86e9d3e tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] Calling method '.version_select at 0x7fdd3b872280>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:12.824750 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-319bf0e3-1eb3-451c-a407-b1af38bda39d tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212" status: 200 len: 345 microversion: 2.1 time: 0.154726 May 10 19:56:12.825714 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:12 2022] GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212 => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 19:56:12.918720 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ba0cdb83-cdfb-44f6-bcc5-1b2fb86e9d3e tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195" status: 200 len: 351 microversion: 2.1 time: 0.225105 May 10 19:56:12.924968 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:12 2022] GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195 => generated 351 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:13.632176 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-416363676", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "networks": [{"uuid": "3c878f7c-4fc9-4a35-81d1-78fb260307a8"}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:13.830259 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] validate_networks() for [('3c878f7c-4fc9-4a35-81d1-78fb260307a8', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 19:56:13.837570 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b9229fb8-2626-4813-8235-5f5af3eee318 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b872430>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:13.922277 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b9229fb8-2626-4813-8235-5f5af3eee318 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212" status: 200 len: 346 microversion: 2.1 time: 0.088876 May 10 19:56:13.923346 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 3/5] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:13 2022] GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212 => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 19:56:13.937434 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7e34b621-dc4c-4893-9ad3-8904ed4945f8 tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] Calling method '.version_select at 0x7fdd3b872a60>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:14.046878 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7e34b621-dc4c-4893-9ad3-8904ed4945f8 tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195" status: 200 len: 352 microversion: 2.1 time: 0.119337 May 10 19:56:14.048101 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 4/6] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:13 2022] GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 19:56:14.058792 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a5af9d30-88d0-4a97-951f-1306b95b5125 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Action: 'create', calling method: .version_select at 0x7fdd3b87e0d0>, body: {"snapshot": {"volume_id": "9aa53a21-43e9-4484-8304-b32a21dec212", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1931609336"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:14.629777 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a5af9d30-88d0-4a97-951f-1306b95b5125 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.580418 May 10 19:56:14.631868 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 5/7] 10.222.0.57 () {60 vars in 1161 bytes} [Tue May 10 19:56:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:14.636783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d538d0ae-c760-4835-8592-edf770930c01 tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] Calling method '.version_select at 0x7fdd3b872d30>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:14.745605 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d538d0ae-c760-4835-8592-edf770930c01 tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195" status: 200 len: 352 microversion: 2.1 time: 0.112470 May 10 19:56:14.747336 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 6/8] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:14 2022] GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:14.754513 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9871f183-bd05-46cf-93dc-3ca1e52009af tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b8720d0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:14.820609 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9871f183-bd05-46cf-93dc-3ca1e52009af tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d" status: 200 len: 287 microversion: 2.1 time: 0.071838 May 10 19:56:14.821194 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 7/9] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 19:56:14 2022] GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:14.826136 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c45a8653-fcef-4f42-ad63-79caf24dcbda tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] Calling method '.version_select at 0x7fdd3b87e160>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:15.024028 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c45a8653-fcef-4f42-ad63-79caf24dcbda tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195" status: 202 len: 0 microversion: 2.1 time: 0.201335 May 10 19:56:15.024705 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 8/10] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 19:56:14 2022] DELETE /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 19:56:15.030634 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-97bf42a3-e96c-4efb-8210-8f15c683e33d tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b872430>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:15.118822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-97bf42a3-e96c-4efb-8210-8f15c683e33d tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.093031 May 10 19:56:15.119407 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 9/11] 10.222.0.57 () {58 vars in 1139 bytes} [Tue May 10 19:56:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:15.128929 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-90e6b69f-4adc-42b5-8c3b-a1653d3ad4f2 tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] Calling method '.version_select at 0x7fdd3b87e4c0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:15.219453 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-90e6b69f-4adc-42b5-8c3b-a1653d3ad4f2 tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195" status: 200 len: 351 microversion: 2.1 time: 0.098696 May 10 19:56:15.220545 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 10/12] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:15 2022] GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195 => generated 351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:15.228428 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-54ae88a7-29e2-48fe-be5b-a5d45e50aa04 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b87e280>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:15.296840 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-54ae88a7-29e2-48fe-be5b-a5d45e50aa04 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d" status: 200 len: 287 microversion: 2.1 time: 0.073833 May 10 19:56:15.297735 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 11/13] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 19:56:15 2022] GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:16.231470 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a344a400-9223-471f-a421-3378352b2f8b tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] Calling method '.version_select at 0x7fdd3b872b80>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:16.380203 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a344a400-9223-471f-a421-3378352b2f8b tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195" status: 200 len: 351 microversion: 2.1 time: 0.152231 May 10 19:56:16.381663 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 12/14] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:16 2022] GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195 => generated 351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 19:56:16.387726 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b4465610-ee84-4765-98a7-1a2a7f750ddf tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b872670>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:16.424647 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b4465610-ee84-4765-98a7-1a2a7f750ddf tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d" status: 200 len: 287 microversion: 2.1 time: 0.040860 May 10 19:56:16.425242 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 13/15] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 19:56:16 2022] GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:16.490144 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 19:56:16.492578 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 19:56:16.493805 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 19:56:16.494591 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 19:56:16.495338 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 19:56:16.526262 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:16.528680 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:16.530406 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:16.531137 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:16.573999 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Getting quotas for project 25b61967dc5c42ceb097f40a01045bfa. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:56:16.592910 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Getting quotas for user 7f3cef4a86dd4b9cb57619148760ba88 and project 25b61967dc5c42ceb097f40a01045bfa. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:56:16.616825 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 19:56:16.656496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 19:56:16.852838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-26acb5e9-182d-4197-b998-30cbf2148c56 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.373373 May 10 19:56:16.853803 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 3/16] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 19:56:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 19:56:16.864344 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c2b8d517-0501-4067-99be-23ef29e0b97d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:16.865227 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c2b8d517-0501-4067-99be-23ef29e0b97d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:17.393848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5771a390-e22a-4a4a-8f95-42ac30c80260 tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] Calling method '.version_select at 0x7fdd3af7bf70>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:17.478159 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5771a390-e22a-4a4a-8f95-42ac30c80260 tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195" status: 200 len: 351 microversion: 2.1 time: 0.088479 May 10 19:56:17.479029 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 4/17] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:17 2022] GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195 => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 19:56:17.487446 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0b7455dc-6ede-47dd-9f0f-e37f982e7ddd tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3af935e0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:17.537455 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0b7455dc-6ede-47dd-9f0f-e37f982e7ddd tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d" status: 200 len: 287 microversion: 2.1 time: 0.057357 May 10 19:56:17.538739 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 5/18] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 19:56:17 2022] GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:17.613950 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c2b8d517-0501-4067-99be-23ef29e0b97d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:17.643322 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c2b8d517-0501-4067-99be-23ef29e0b97d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1214 microversion: 2.1 time: 0.783323 May 10 19:56:17.644207 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 14/19] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:16 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1214 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:56:18.491889 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b5522d43-3e1b-48fd-8971-9724947e8e4a tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] Calling method '.version_select at 0x7fdd3af93d30>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:18.549476 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-b5522d43-3e1b-48fd-8971-9724947e8e4a tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] HTTP exception thrown: Volume cd47a74f-5b40-44fe-9751-37dff8480195 could not be found. May 10 19:56:18.556123 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-295de35d-3a62-40a9-8b2f-400d33ec2957 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b8720d0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b5522d43-3e1b-48fd-8971-9724947e8e4a tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] Request method failure captured: May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195 HTTP/1.1 May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNZS18Wm8Ne5GuzXUbRy5xRRgtZPVJeelvQE-NaJGtvA3-aKOyy6NQTmAoVrWXjab8AAVAjwj7au2hIuCmTj-GYThXwuV0co19qMStq9OPGAeTzx-cAEOMpljBp7WMMrmhDoSTUcWqyFpVqf20ZQkdrUtRjoug7l9dHCuUqVS3SR3I May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 1b813fb184334b39bc1facf8b3de8b60 May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-VolumesGetTestJSON-27110955 May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 19:56:18.559019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1b813fb184334b39bc1facf8b3de8b60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1b813fb184334b39bc1facf8b3de8b60", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1b813fb184334b39bc1facf8b3de8b60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1b813fb184334b39bc1facf8b3de8b60"}]}] May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-VolumesGetTestJSON-27110955 May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 1b813fb184334b39bc1facf8b3de8b60 May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-VolumesGetTestJSON-27110955 May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-VolumesGetTestJSON-27110955-project May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: e52e91625cbe4e5faaa45ade47ff8599 May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-VolumesGetTestJSON-27110955-project May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Volume cd47a74f-5b40-44fe-9751-37dff8480195 could not be found. May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': 'cd47a74f-5b40-44fe-9751-37dff8480195'} May 10 19:56:18.560081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd47a74f-5b40-44fe-9751-37dff8480195 could not be found. (HTTP 404) (Request-ID: req-44aaabb8-4a38-47e1-9ac0-02730b29e01d) May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:18.560689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 19:56:18.561569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd47a74f-5b40-44fe-9751-37dff8480195 could not be found. May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 19:56:18.562486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:56:18.563344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd47a74f-5b40-44fe-9751-37dff8480195 could not be found. May 10 19:56:18.563344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:18.563344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:18.563344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:18.563344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:18.563344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:56:18.563344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:56:18.563344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:56:18.563344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:56:18.563344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd47a74f-5b40-44fe-9751-37dff8480195 could not be found. May 10 19:56:18.563344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:18.569172 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b5522d43-3e1b-48fd-8971-9724947e8e4a tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] Returning 404 to user: Volume cd47a74f-5b40-44fe-9751-37dff8480195 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:56:18.570449 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b5522d43-3e1b-48fd-8971-9724947e8e4a tempest-VolumesGetTestJSON-27110955 tempest-VolumesGetTestJSON-27110955-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195" status: 404 len: 109 microversion: 2.1 time: 0.083749 May 10 19:56:18.571260 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 6/20] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:18 2022] GET /compute/v2.1/os-volumes/cd47a74f-5b40-44fe-9751-37dff8480195 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 19:56:18.662842 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-49c5ad37-bc61-4cd5-af3c-99dde0554024 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:18.663690 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-49c5ad37-bc61-4cd5-af3c-99dde0554024 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:18.707698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49c5ad37-bc61-4cd5-af3c-99dde0554024 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:18.710909 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49c5ad37-bc61-4cd5-af3c-99dde0554024 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:18.711911 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49c5ad37-bc61-4cd5-af3c-99dde0554024 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:18.717615 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49c5ad37-bc61-4cd5-af3c-99dde0554024 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:18.754138 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-295de35d-3a62-40a9-8b2f-400d33ec2957 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d" status: 200 len: 288 microversion: 2.1 time: 0.208467 May 10 19:56:18.754751 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 15/21] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 19:56:18 2022] GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d => generated 288 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:18.767093 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a0142c33-ed92-425b-9c12-cb23b0459731 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b8541f0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:18.943202 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a0142c33-ed92-425b-9c12-cb23b0459731 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d" status: 202 len: 0 microversion: 2.1 time: 0.178970 May 10 19:56:18.943788 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 16/22] 10.222.0.57 () {58 vars in 1253 bytes} [Tue May 10 19:56:18 2022] DELETE /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 19:56:18.952894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1404deb3-c6a6-4822-9c8d-991b79e529ad tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b8548b0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:19.056758 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1404deb3-c6a6-4822-9c8d-991b79e529ad tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d" status: 200 len: 287 microversion: 2.1 time: 0.108131 May 10 19:56:19.057376 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 17/23] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 19:56:18 2022] GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:19.283163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-49c5ad37-bc61-4cd5-af3c-99dde0554024 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:19.308346 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-49c5ad37-bc61-4cd5-af3c-99dde0554024 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1218 microversion: 2.1 time: 0.650918 May 10 19:56:19.315824 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 7/24] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:18 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1218 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:56:20.069311 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9b9d37a4-c5d0-41b2-9846-dab20273e0b0 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b844c10>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:20.116294 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-9b9d37a4-c5d0-41b2-9846-dab20273e0b0 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] HTTP exception thrown: Snapshot 483feb80-b4ae-4714-b613-5f9fa58be02d could not be found. May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9b9d37a4-c5d0-41b2-9846-dab20273e0b0 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Request method failure captured: May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d HTTP/1.1 May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNZwcAlXlMSLIKAicj1KzknMG-_vATznBZLjDHQiu4oCMH7I2XM2lYRBksj6_wdtKn0zKMW1erTXUb9aGT9MC-QALfvhUDP71xnV9pmvW8Kk_BfJMvOHs5mUc0kKEfrRFrGTPZ7M-VYOSN_K_c3299NyIpP0JVtBLTXF6KWLZb1FAk May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: aa90dbe567f64d1baef66ee3292ba7fb May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 19:56:20.120429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa90dbe567f64d1baef66ee3292ba7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa90dbe567f64d1baef66ee3292ba7fb", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa90dbe567f64d1baef66ee3292ba7fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa90dbe567f64d1baef66ee3292ba7fb"}]}] May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: aa90dbe567f64d1baef66ee3292ba7fb May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-VolumesSnapshotsTestJSON-619650532-project May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 5cc7460a926a47eeb676d7ffdf0102c8 May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-VolumesSnapshotsTestJSON-619650532-project May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Snapshot 483feb80-b4ae-4714-b613-5f9fa58be02d could not be found. May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '483feb80-b4ae-4714-b613-5f9fa58be02d'} May 10 19:56:20.121450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 483feb80-b4ae-4714-b613-5f9fa58be02d could not be found. (HTTP 404) (Request-ID: req-e65df3b7-31c5-4132-ad86-d2bc9153f13a) May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:20.122053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 19:56:20.122893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 483feb80-b4ae-4714-b613-5f9fa58be02d could not be found. May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 19:56:20.123817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:56:20.124975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 483feb80-b4ae-4714-b613-5f9fa58be02d could not be found. May 10 19:56:20.124975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:20.124975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:20.124975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:20.124975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:20.124975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:56:20.124975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:56:20.124975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:56:20.124975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:56:20.124975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 483feb80-b4ae-4714-b613-5f9fa58be02d could not be found. May 10 19:56:20.124975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:20.127744 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9b9d37a4-c5d0-41b2-9846-dab20273e0b0 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Returning 404 to user: Snapshot 483feb80-b4ae-4714-b613-5f9fa58be02d could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:56:20.128836 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9b9d37a4-c5d0-41b2-9846-dab20273e0b0 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d" status: 404 len: 111 microversion: 2.1 time: 0.064202 May 10 19:56:20.129989 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 18/25] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 19:56:20 2022] GET /compute/v2.1/os-snapshots/483feb80-b4ae-4714-b613-5f9fa58be02d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 19:56:20.138228 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5929d029-81d8-4888-bceb-415a27c2a839 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3a6851f0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:20.280652 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5929d029-81d8-4888-bceb-415a27c2a839 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212" status: 202 len: 0 microversion: 2.1 time: 0.146329 May 10 19:56:20.281238 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 8/26] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 19:56:20 2022] DELETE /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 19:56:20.291373 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-49d5e402-ae42-45fa-adc7-a73d169a1d09 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3c246790>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:20.333463 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f995d4a4-e4e7-4f10-adba-1c4c469df257 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:20.334138 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f995d4a4-e4e7-4f10-adba-1c4c469df257 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:20.346844 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f995d4a4-e4e7-4f10-adba-1c4c469df257 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:20.347523 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f995d4a4-e4e7-4f10-adba-1c4c469df257 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:20.348507 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f995d4a4-e4e7-4f10-adba-1c4c469df257 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:20.349684 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f995d4a4-e4e7-4f10-adba-1c4c469df257 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:20.368895 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-49d5e402-ae42-45fa-adc7-a73d169a1d09 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212" status: 200 len: 345 microversion: 2.1 time: 0.083249 May 10 19:56:20.377047 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 19/27] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:20 2022] GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212 => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:20.505700 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f995d4a4-e4e7-4f10-adba-1c4c469df257 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:20.515658 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f995d4a4-e4e7-4f10-adba-1c4c469df257 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1266 microversion: 2.1 time: 0.186942 May 10 19:56:20.516481 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 9/28] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:20 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:56:21.383390 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-10e43cec-e279-4103-b126-3cee86b07d46 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b823430>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:21.502232 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-10e43cec-e279-4103-b126-3cee86b07d46 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212" status: 200 len: 345 microversion: 2.1 time: 0.123114 May 10 19:56:21.503379 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 20/29] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:21 2022] GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212 => generated 345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:21.554383 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9e0d8049-cf41-43c0-97fd-4f9b58a5145f tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:21.555256 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9e0d8049-cf41-43c0-97fd-4f9b58a5145f tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:21.573857 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e0d8049-cf41-43c0-97fd-4f9b58a5145f tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:21.574585 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e0d8049-cf41-43c0-97fd-4f9b58a5145f tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:21.575522 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e0d8049-cf41-43c0-97fd-4f9b58a5145f tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:21.579569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e0d8049-cf41-43c0-97fd-4f9b58a5145f tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:21.921253 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9e0d8049-cf41-43c0-97fd-4f9b58a5145f tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:21.936628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9e0d8049-cf41-43c0-97fd-4f9b58a5145f tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1266 microversion: 2.1 time: 0.402579 May 10 19:56:21.948133 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 10/30] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:21 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1266 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:22.260356 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cd2ac82b-f547-4050-be7d-f0d1576266cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: .version_select at 0x7fdd3b823a60>, body: {"keypair": {"name": "tempest-keypair-1802312051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODbJEGlfYbdLSW2M65pYdqr3O1piJH7IOTE+15TfdhXPqk/8p3ni8S37yI0P4eB/J/rd13RrZPdnRymNUrb8qA+BwAxz4Y7J5eVF+Yzd/EpNarf1hPzlAT+5fOuHQWdJw=="}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:22.341973 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-cd2ac82b-f547-4050-be7d-f0d1576266cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for project 477a9d7174e544efbbe7803ca7e77521. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:56:22.359274 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-cd2ac82b-f547-4050-be7d-f0d1576266cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for user 2751fce03c284a91b152f545bd8c63ce and project 477a9d7174e544efbbe7803ca7e77521. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:56:22.492789 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cd2ac82b-f547-4050-be7d-f0d1576266cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.633352 May 10 19:56:22.494703 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 21/31] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 19:56:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:22.516532 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-bf6583c9-0965-4012-a271-784f7dfb9853 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3a651b80>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:22.588943 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-bf6583c9-0965-4012-a271-784f7dfb9853 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] HTTP exception thrown: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-bf6583c9-0965-4012-a271-784f7dfb9853 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Request method failure captured: May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212 HTTP/1.1 May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNZwcAlXlMSLIKAicj1KzknMG-_vATznBZLjDHQiu4oCMH7I2XM2lYRBksj6_wdtKn0zKMW1erTXUb9aGT9MC-QALfvhUDP71xnV9pmvW8Kk_BfJMvOHs5mUc0kKEfrRFrGTPZ7M-VYOSN_K_c3299NyIpP0JVtBLTXF6KWLZb1FAk May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: aa90dbe567f64d1baef66ee3292ba7fb May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 19:56:22.591166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa90dbe567f64d1baef66ee3292ba7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa90dbe567f64d1baef66ee3292ba7fb", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa90dbe567f64d1baef66ee3292ba7fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa90dbe567f64d1baef66ee3292ba7fb"}]}] May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: aa90dbe567f64d1baef66ee3292ba7fb May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-VolumesSnapshotsTestJSON-619650532-project May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 5cc7460a926a47eeb676d7ffdf0102c8 May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-VolumesSnapshotsTestJSON-619650532-project May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '9aa53a21-43e9-4484-8304-b32a21dec212'} May 10 19:56:22.592173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. (HTTP 404) (Request-ID: req-469ea74d-7ede-4468-b756-f49ad375479b) May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:22.592776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 19:56:22.593637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 19:56:22.594628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-bf6583c9-0965-4012-a271-784f7dfb9853 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Returning 404 to user: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:56:22.595504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-bf6583c9-0965-4012-a271-784f7dfb9853 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212" status: 404 len: 109 microversion: 2.1 time: 0.081358 May 10 19:56:22.611127 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 11/32] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:22 2022] GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 19:56:22.616247 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6a2c3d0d-33bc-42c3-ae13-78ae2e35569d tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3b776e50>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:22.678415 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-6a2c3d0d-33bc-42c3-ae13-78ae2e35569d tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] HTTP exception thrown: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6a2c3d0d-33bc-42c3-ae13-78ae2e35569d tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Request method failure captured: May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: DELETE /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212 HTTP/1.1 May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNZwcAlXlMSLIKAicj1KzknMG-_vATznBZLjDHQiu4oCMH7I2XM2lYRBksj6_wdtKn0zKMW1erTXUb9aGT9MC-QALfvhUDP71xnV9pmvW8Kk_BfJMvOHs5mUc0kKEfrRFrGTPZ7M-VYOSN_K_c3299NyIpP0JVtBLTXF6KWLZb1FAk May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: aa90dbe567f64d1baef66ee3292ba7fb May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 19:56:22.693399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa90dbe567f64d1baef66ee3292ba7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa90dbe567f64d1baef66ee3292ba7fb", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa90dbe567f64d1baef66ee3292ba7fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa90dbe567f64d1baef66ee3292ba7fb"}]}] May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: aa90dbe567f64d1baef66ee3292ba7fb May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-VolumesSnapshotsTestJSON-619650532-project May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 5cc7460a926a47eeb676d7ffdf0102c8 May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-VolumesSnapshotsTestJSON-619650532-project May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '9aa53a21-43e9-4484-8304-b32a21dec212'} May 10 19:56:22.694635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. (HTTP 404) (Request-ID: req-09f3b041-2db7-47dc-9b28-0401c47d5b08) May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:22.695318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 19:56:22.696317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 19:56:22.697340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:56:22.698670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.698670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:22.698670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:22.698670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:22.698670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.698670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:56:22.698670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:56:22.698670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:56:22.698670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:56:22.698670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.698670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:56:22.700381 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6a2c3d0d-33bc-42c3-ae13-78ae2e35569d tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Returning 404 to user: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:56:22.705942 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6a2c3d0d-33bc-42c3-ae13-78ae2e35569d tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212" status: 404 len: 109 microversion: 2.1 time: 0.094694 May 10 19:56:22.708298 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 22/33] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 19:56:22 2022] DELETE /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 19:56:22.717048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-05ef0903-5859-4558-aa9b-4cca168fa2a9 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Calling method '.version_select at 0x7fdd3a64b550>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:22.837822 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-05ef0903-5859-4558-aa9b-4cca168fa2a9 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] HTTP exception thrown: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-05ef0903-5859-4558-aa9b-4cca168fa2a9 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Request method failure captured: May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212 HTTP/1.1 May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNZwcAlXlMSLIKAicj1KzknMG-_vATznBZLjDHQiu4oCMH7I2XM2lYRBksj6_wdtKn0zKMW1erTXUb9aGT9MC-QALfvhUDP71xnV9pmvW8Kk_BfJMvOHs5mUc0kKEfrRFrGTPZ7M-VYOSN_K_c3299NyIpP0JVtBLTXF6KWLZb1FAk May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: aa90dbe567f64d1baef66ee3292ba7fb May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 19:56:22.841153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa90dbe567f64d1baef66ee3292ba7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa90dbe567f64d1baef66ee3292ba7fb", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa90dbe567f64d1baef66ee3292ba7fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa90dbe567f64d1baef66ee3292ba7fb"}]}] May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: aa90dbe567f64d1baef66ee3292ba7fb May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-619650532 May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-VolumesSnapshotsTestJSON-619650532-project May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 5cc7460a926a47eeb676d7ffdf0102c8 May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-VolumesSnapshotsTestJSON-619650532-project May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '9aa53a21-43e9-4484-8304-b32a21dec212'} May 10 19:56:22.842372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. (HTTP 404) (Request-ID: req-08cbb44b-4fac-46c7-af7f-59677b110576) May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:22.843330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 19:56:22.844780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 19:56:22.846214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:56:22.847515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.847515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.847515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:56:22.847515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.847515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:56:22.847515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:56:22.847515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:56:22.847515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:56:22.847515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:56:22.847515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. May 10 19:56:22.847515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:56:22.849918 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-05ef0903-5859-4558-aa9b-4cca168fa2a9 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] Returning 404 to user: Volume 9aa53a21-43e9-4484-8304-b32a21dec212 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:56:22.851035 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-05ef0903-5859-4558-aa9b-4cca168fa2a9 tempest-VolumesSnapshotsTestJSON-619650532 tempest-VolumesSnapshotsTestJSON-619650532-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212" status: 404 len: 109 microversion: 2.1 time: 0.139237 May 10 19:56:22.852262 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 12/34] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:22 2022] GET /compute/v2.1/os-volumes/9aa53a21-43e9-4484-8304-b32a21dec212 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 19:56:22.955036 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4b2c2af0-cda7-4374-b4be-daca78c5f32e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:22.955838 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4b2c2af0-cda7-4374-b4be-daca78c5f32e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:22.976891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4b2c2af0-cda7-4374-b4be-daca78c5f32e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:22.983350 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4b2c2af0-cda7-4374-b4be-daca78c5f32e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:22.986345 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4b2c2af0-cda7-4374-b4be-daca78c5f32e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:22.988378 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4b2c2af0-cda7-4374-b4be-daca78c5f32e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:23.433266 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4b2c2af0-cda7-4374-b4be-daca78c5f32e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:23.454932 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4b2c2af0-cda7-4374-b4be-daca78c5f32e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1284 microversion: 2.1 time: 0.503530 May 10 19:56:23.456790 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 23/35] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:22 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1284 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:24.475158 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3f440d5f-64f2-4ade-af26-ce7201976593 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:24.476494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3f440d5f-64f2-4ade-af26-ce7201976593 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:24.488775 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f440d5f-64f2-4ade-af26-ce7201976593 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:24.489954 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f440d5f-64f2-4ade-af26-ce7201976593 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:24.493183 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f440d5f-64f2-4ade-af26-ce7201976593 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:24.493926 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f440d5f-64f2-4ade-af26-ce7201976593 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:24.692256 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3f440d5f-64f2-4ade-af26-ce7201976593 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:24.701279 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3f440d5f-64f2-4ade-af26-ce7201976593 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1272 microversion: 2.1 time: 0.231635 May 10 19:56:24.702918 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 13/36] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:24 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:25.534262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8d2cb8ed-c955-4ddb-a76e-d549c8b79c7c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Action: 'create', calling method: .version_select at 0x7fdd3aebaa60>, body: {"keypair": {"name": "tempest-keypair-151716783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8tLXk/0rhH7aKPNAzTMwD5zkG0jpbbEkCDBlJojIDY8Bbo5SIR0CN6Ttm17y4H8+kJMu9dbSfBs0cAfT8r/Qe7VSHaZzV9qoJuDlpeT6n9IMZEILqw1udNzOpfn+Y6kQ=="}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:25.595609 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-8d2cb8ed-c955-4ddb-a76e-d549c8b79c7c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Getting quotas for project bfb1f4857a6e438e87e546dfd1d8a8b9. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:56:25.605527 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-8d2cb8ed-c955-4ddb-a76e-d549c8b79c7c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Getting quotas for user 0b7dead8216e4cd59eaa15ad8842e38a and project bfb1f4857a6e438e87e546dfd1d8a8b9. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:56:25.669954 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8d2cb8ed-c955-4ddb-a76e-d549c8b79c7c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.527147 May 10 19:56:25.671379 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 24/37] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 19:56:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:25.675240 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1561375352", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:25.720607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1dfde589-0b3d-4ba5-8f04-b564892dec1b tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:25.721715 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1dfde589-0b3d-4ba5-8f04-b564892dec1b tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:25.741108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1dfde589-0b3d-4ba5-8f04-b564892dec1b tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:25.741577 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1dfde589-0b3d-4ba5-8f04-b564892dec1b tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:25.760146 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1dfde589-0b3d-4ba5-8f04-b564892dec1b tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:25.761304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1dfde589-0b3d-4ba5-8f04-b564892dec1b tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:25.911634 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] validate_networks() for [('7e89c795-c88b-4f30-8394-9a44ee218158', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 19:56:26.100879 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1dfde589-0b3d-4ba5-8f04-b564892dec1b tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:26.118289 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1dfde589-0b3d-4ba5-8f04-b564892dec1b tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1272 microversion: 2.1 time: 0.402118 May 10 19:56:26.123414 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 25/38] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:25 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1272 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:26.626576 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0f636f47-c6c6-4848-ab35-50ecaeb2de1d tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] Calling method '.version_select at 0x7fdd3aec4b80>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:26.741328 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0f636f47-c6c6-4848-ab35-50ecaeb2de1d tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/43339ac1-e90e-49ab-817e-cafd90ba6098" status: 200 len: 351 microversion: 2.1 time: 0.119339 May 10 19:56:26.741912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 26/39] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:26 2022] GET /compute/v2.1/os-volumes/43339ac1-e90e-49ab-817e-cafd90ba6098 => generated 351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 19:56:27.143633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0288f595-953f-43d2-880f-de5b0e7c9996 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:27.144839 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0288f595-953f-43d2-880f-de5b0e7c9996 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:27.157444 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0288f595-953f-43d2-880f-de5b0e7c9996 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:27.159637 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0288f595-953f-43d2-880f-de5b0e7c9996 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:27.162175 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0288f595-953f-43d2-880f-de5b0e7c9996 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:27.166392 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0288f595-953f-43d2-880f-de5b0e7c9996 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:27.678216 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0288f595-953f-43d2-880f-de5b0e7c9996 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:27.704679 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0288f595-953f-43d2-880f-de5b0e7c9996 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 0.559641 May 10 19:56:27.715569 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 27/40] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:27 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:28.375507 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 19:56:28.379036 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 19:56:28.380167 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 19:56:28.380604 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 19:56:28.381033 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 19:56:28.420566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:28.431648 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:28.437035 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:28.437509 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:28.508075 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Getting quotas for project 866e5dd5364e4bd980ba03f1b76aac9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:56:28.531734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Getting quotas for user b642ac529ee043fd894a9188f30ed026 and project 866e5dd5364e4bd980ba03f1b76aac9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:56:28.568384 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 19:56:28.575825 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 19:56:28.720142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-85f8df2d-d518-4db1-be59-6b639305f545 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.274219 May 10 19:56:28.722850 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 14/41] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 19:56:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 3279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 19:56:28.736956 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b942d94d-f225-4b8c-a443-5649e9f513ad tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:28.739005 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b942d94d-f225-4b8c-a443-5649e9f513ad tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:28.748585 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-68d522cb-00d9-4ecd-b98a-f260f717ff44 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:28.749570 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-68d522cb-00d9-4ecd-b98a-f260f717ff44 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:28.763237 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b942d94d-f225-4b8c-a443-5649e9f513ad tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:28.772647 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b942d94d-f225-4b8c-a443-5649e9f513ad tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:28.784486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b942d94d-f225-4b8c-a443-5649e9f513ad tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:28.790809 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b942d94d-f225-4b8c-a443-5649e9f513ad tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:30.058435 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-68d522cb-00d9-4ecd-b98a-f260f717ff44 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:30.087476 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-68d522cb-00d9-4ecd-b98a-f260f717ff44 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1222 microversion: 2.1 time: 1.354330 May 10 19:56:30.104661 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 15/42] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:28 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1222 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:30.111830 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6af2fd19-627e-4e94-8c5c-2f7a6ee268c9 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] Calling method '.version_select at 0x7fdd3a64bd30>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:30.205022 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6af2fd19-627e-4e94-8c5c-2f7a6ee268c9 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/78fc0509-f897-49b7-89b8-ca0826801798" status: 200 len: 351 microversion: 2.1 time: 0.098499 May 10 19:56:30.206114 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 16/43] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:30 2022] GET /compute/v2.1/os-volumes/78fc0509-f897-49b7-89b8-ca0826801798 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:30.594150 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b942d94d-f225-4b8c-a443-5649e9f513ad tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:30.615367 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b942d94d-f225-4b8c-a443-5649e9f513ad tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 1.897197 May 10 19:56:30.621972 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 28/44] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:28 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:30.848801 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-144716152", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:30.894557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-157856325", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c69c6345-64af-49e8-8bf3-adcceaa64462"}], "security_groups": [{"name": "tempest-securitygroup--370758869"}], "key_name": "tempest-keypair-1802312051", "user_data": "}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:31.046135 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] validate_networks() for [('7e89c795-c88b-4f30-8394-9a44ee218158', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 19:56:32.091989 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 19:56:32.093135 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 19:56:32.093812 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 19:56:32.094413 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 19:56:32.095051 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 19:56:32.116400 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:32.117228 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:32.118300 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:32.118951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:32.175400 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Getting quotas for project 866e5dd5364e4bd980ba03f1b76aac9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:56:32.208131 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Getting quotas for user b642ac529ee043fd894a9188f30ed026 and project 866e5dd5364e4bd980ba03f1b76aac9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:56:32.316548 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 19:56:32.326740 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 19:56:32.361558 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] validate_networks() for [('c69c6345-64af-49e8-8bf3-adcceaa64462', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 19:56:32.525543 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-761e03f6-03ab-4cc0-9a48-c35bfe1c4747 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.679417 May 10 19:56:32.537418 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 17/45] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 19:56:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 19:56:32.552319 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-de072776-697d-4f9c-a790-4f40f56316a1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:32.554427 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-de072776-697d-4f9c-a790-4f40f56316a1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:32.579904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-de072776-697d-4f9c-a790-4f40f56316a1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:32.585909 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-de072776-697d-4f9c-a790-4f40f56316a1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:32.587630 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-de072776-697d-4f9c-a790-4f40f56316a1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:32.595654 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-de072776-697d-4f9c-a790-4f40f56316a1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:33.490654 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-de072776-697d-4f9c-a790-4f40f56316a1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:33.504581 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-de072776-697d-4f9c-a790-4f40f56316a1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 0.961358 May 10 19:56:33.508802 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 18/46] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:32 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:33.560174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-74ddc3f8-669b-476e-84b4-3394fbf6f405 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] Calling method '.version_select at 0x7fdd3a64b700>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:33.845227 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-74ddc3f8-669b-476e-84b4-3394fbf6f405 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/88abedb3-5ce5-4d1f-87dd-1e70392878b0" status: 200 len: 350 microversion: 2.1 time: 0.328229 May 10 19:56:33.846135 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 19/47] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:56:33 2022] GET /compute/v2.1/os-volumes/88abedb3-5ce5-4d1f-87dd-1e70392878b0 => generated 350 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:33.860525 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ff18ad6e-669a-4dbe-b674-1dbdd1acc756 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:33.866302 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ff18ad6e-669a-4dbe-b674-1dbdd1acc756 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:33.886533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff18ad6e-669a-4dbe-b674-1dbdd1acc756 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:33.887044 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff18ad6e-669a-4dbe-b674-1dbdd1acc756 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:33.887886 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff18ad6e-669a-4dbe-b674-1dbdd1acc756 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:33.888370 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff18ad6e-669a-4dbe-b674-1dbdd1acc756 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:34.101088 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ff18ad6e-669a-4dbe-b674-1dbdd1acc756 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:34.131279 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ff18ad6e-669a-4dbe-b674-1dbdd1acc756 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1225 microversion: 2.1 time: 0.283956 May 10 19:56:34.139098 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 20/48] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:33 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1225 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:34.170256 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-53953c88-ea5b-43fd-97a8-ec1d102c3f51 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] Calling method '.version_select at 0x7fdd3a64bee0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:34.499554 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-53953c88-ea5b-43fd-97a8-ec1d102c3f51 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.344489 May 10 19:56:34.500179 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 21/49] 10.222.0.57 () {58 vars in 1133 bytes} [Tue May 10 19:56:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:34.533012 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1cc70e67-488d-4846-a37f-8d503dae6a09 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] Calling method '.version_select at 0x7fdd3a664d30>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:34.728859 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1cc70e67-488d-4846-a37f-8d503dae6a09 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.207300 May 10 19:56:34.730015 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 22/50] 10.222.0.57 () {58 vars in 1148 bytes} [Tue May 10 19:56:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:34.742114 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6f2ff297-dc06-4d19-8b47-1098e8651284 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:34.743241 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6f2ff297-dc06-4d19-8b47-1098e8651284 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:34.767749 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6f2ff297-dc06-4d19-8b47-1098e8651284 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:34.774144 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6f2ff297-dc06-4d19-8b47-1098e8651284 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:34.776734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6f2ff297-dc06-4d19-8b47-1098e8651284 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:34.780495 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6f2ff297-dc06-4d19-8b47-1098e8651284 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:36.555874 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6f2ff297-dc06-4d19-8b47-1098e8651284 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:36.563564 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6f2ff297-dc06-4d19-8b47-1098e8651284 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 1.832238 May 10 19:56:36.577047 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 23/51] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:34 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:36.583957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-aa5e7fa3-4ec3-4b42-9026-8c108496c0e7 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] Calling method '.version_select at 0x7fdd3a664dc0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:36.752670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 19:56:36.753336 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 19:56:36.753635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 19:56:36.754051 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 19:56:36.754701 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 19:56:36.796003 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:36.800084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:36.804637 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:36.805161 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:36.923074 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for project 477a9d7174e544efbbe7803ca7e77521. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:56:36.940841 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for user 2751fce03c284a91b152f545bd8c63ce and project 477a9d7174e544efbbe7803ca7e77521. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:56:36.973137 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-aa5e7fa3-4ec3-4b42-9026-8c108496c0e7 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.394635 May 10 19:56:36.974370 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 24/52] 10.222.0.57 () {58 vars in 1133 bytes} [Tue May 10 19:56:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:36.979588 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 19:56:36.980526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-bc7461e4-fedf-468e-adb1-e815d5c84d40 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:36.981407 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-bc7461e4-fedf-468e-adb1-e815d5c84d40 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:36.994412 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 19:56:36.995190 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bc7461e4-fedf-468e-adb1-e815d5c84d40 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:36.996874 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bc7461e4-fedf-468e-adb1-e815d5c84d40 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:36.999356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bc7461e4-fedf-468e-adb1-e815d5c84d40 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:37.000973 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bc7461e4-fedf-468e-adb1-e815d5c84d40 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:37.206534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7b47b310-6a68-486f-bde9-d67631bae927 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.317480 May 10 19:56:37.207979 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 29/53] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 19:56:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 6319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 19:56:37.531849 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-26ec87a5-a3d0-4a86-9857-ee6ce630c136 req-e84b8858-00d0-4e88-9c37-1e96d0fa5001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c845f562-743f-4236-89b6-eaff7c82e2dd", "tag": "489d3fae-f45c-4b37-8432-9a1c0e9e3eec"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:37.556581 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-26ec87a5-a3d0-4a86-9857-ee6ce630c136 req-e84b8858-00d0-4e88-9c37-1e96d0fa5001 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:37.557085 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-26ec87a5-a3d0-4a86-9857-ee6ce630c136 req-e84b8858-00d0-4e88-9c37-1e96d0fa5001 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:37.633864 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-bc7461e4-fedf-468e-adb1-e815d5c84d40 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:37.648859 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-26ec87a5-a3d0-4a86-9857-ee6ce630c136 req-e84b8858-00d0-4e88-9c37-1e96d0fa5001 service nova] Creating event network-changed:489d3fae-f45c-4b37-8432-9a1c0e9e3eec for instance c845f562-743f-4236-89b6-eaff7c82e2dd on hv-cinder-84131 May 10 19:56:37.649581 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-bc7461e4-fedf-468e-adb1-e815d5c84d40 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1279 microversion: 2.1 time: 0.673041 May 10 19:56:37.651168 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-26ec87a5-a3d0-4a86-9857-ee6ce630c136 req-e84b8858-00d0-4e88-9c37-1e96d0fa5001 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 19:56:37.653539 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 25/54] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:36 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1279 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:37.668118 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00afecbc-b7b9-41f3-8fd5-03f85d1ad83e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:37.670661 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00afecbc-b7b9-41f3-8fd5-03f85d1ad83e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:37.673140 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00afecbc-b7b9-41f3-8fd5-03f85d1ad83e None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:37.677116 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00afecbc-b7b9-41f3-8fd5-03f85d1ad83e None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:37.682578 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-73e31d77-0b23-43c9-9ecf-9c9c3298a17a tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] Calling method '.version_select at 0x7fdd3a6640d0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:37.717305 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.compute.rpcapi [None req-00afecbc-b7b9-41f3-8fd5-03f85d1ad83e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 19:56:37.719635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00afecbc-b7b9-41f3-8fd5-03f85d1ad83e None None] Releasing lock "compute-rpcapi-router" {{(pid=117125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 19:56:37.796114 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-00afecbc-b7b9-41f3-8fd5-03f85d1ad83e None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.586493 May 10 19:56:37.798797 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 30/55] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:37.804411 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3b794ec8-4f13-4aab-ab94-a94986e0fc02 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:37.814768 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3b794ec8-4f13-4aab-ab94-a94986e0fc02 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:37.944246 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-73e31d77-0b23-43c9-9ecf-9c9c3298a17a tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.288156 May 10 19:56:37.946038 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 26/56] 10.222.0.57 () {58 vars in 1166 bytes} [Tue May 10 19:56:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:37.951851 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-aa22c432-b4bf-410a-a531-88ac01dd72ea tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:37.951851 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-aa22c432-b4bf-410a-a531-88ac01dd72ea tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:37.978999 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa22c432-b4bf-410a-a531-88ac01dd72ea tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:37.979482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa22c432-b4bf-410a-a531-88ac01dd72ea tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:37.981197 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa22c432-b4bf-410a-a531-88ac01dd72ea tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:37.992582 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa22c432-b4bf-410a-a531-88ac01dd72ea tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:38.633786 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3b794ec8-4f13-4aab-ab94-a94986e0fc02 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:38.641789 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3b794ec8-4f13-4aab-ab94-a94986e0fc02 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1241 microversion: 2.1 time: 0.841761 May 10 19:56:38.652028 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 31/57] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:37 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1241 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:38.652028 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d7d609d2-8389-41b4-990a-ff8cfe953ae5 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] Calling method '.version_select at 0x7fdd3ae135e0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:38.922735 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d7d609d2-8389-41b4-990a-ff8cfe953ae5 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.278677 May 10 19:56:38.923628 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 32/58] 10.222.0.57 () {58 vars in 1169 bytes} [Tue May 10 19:56:38 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:38.935525 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b5e92577-dae7-4cfc-8f39-53a712adf783 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:38.936439 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b5e92577-dae7-4cfc-8f39-53a712adf783 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:38.948433 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b5e92577-dae7-4cfc-8f39-53a712adf783 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:38.949108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b5e92577-dae7-4cfc-8f39-53a712adf783 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:38.950081 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b5e92577-dae7-4cfc-8f39-53a712adf783 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:38.971652 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b5e92577-dae7-4cfc-8f39-53a712adf783 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:39.152048 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b5e92577-dae7-4cfc-8f39-53a712adf783 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:39.208233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b5e92577-dae7-4cfc-8f39-53a712adf783 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1279 microversion: 2.1 time: 0.249050 May 10 19:56:39.222571 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 33/59] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:38 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1279 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:39.229418 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6f381c76-5c85-46fa-a0c8-a2b442f3ab2f tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] Calling method '.version_select at 0x7fdd39dc4670>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:39.454254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6f381c76-5c85-46fa-a0c8-a2b442f3ab2f tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.229643 May 10 19:56:39.461506 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 34/60] 10.222.0.57 () {58 vars in 1154 bytes} [Tue May 10 19:56:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:39.467572 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1898461768", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f696180f-7a91-4c53-a5b6-6312e26b7ddf"}], "security_groups": [{"name": "tempest-securitygroup--1506116704"}], "key_name": "tempest-keypair-151716783", "user_data": "}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:39.482394 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-aa22c432-b4bf-410a-a531-88ac01dd72ea tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:39.492962 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-aa22c432-b4bf-410a-a531-88ac01dd72ea tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 1.545528 May 10 19:56:39.506638 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 27/61] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:37 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:39.521859 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3c3de1ce-5d97-4300-9380-6214d0291923 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] Calling method '.version_select at 0x7fdd3a664d30>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:39.690750 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3c3de1ce-5d97-4300-9380-6214d0291923 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.181390 May 10 19:56:39.699222 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 28/62] 10.222.0.57 () {58 vars in 1187 bytes} [Tue May 10 19:56:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:39.700066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-22c09f5b-e4c4-4274-8651-fb405e45fa92 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:39.700820 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-22c09f5b-e4c4-4274-8651-fb405e45fa92 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:39.705272 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] validate_networks() for [('f696180f-7a91-4c53-a5b6-6312e26b7ddf', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 19:56:39.728387 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-22c09f5b-e4c4-4274-8651-fb405e45fa92 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:39.729822 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-22c09f5b-e4c4-4274-8651-fb405e45fa92 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:39.731894 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-22c09f5b-e4c4-4274-8651-fb405e45fa92 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:39.732754 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-22c09f5b-e4c4-4274-8651-fb405e45fa92 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:39.874347 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-22c09f5b-e4c4-4274-8651-fb405e45fa92 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:39.886429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-22c09f5b-e4c4-4274-8651-fb405e45fa92 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1245 microversion: 2.1 time: 0.191871 May 10 19:56:39.887316 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 29/63] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:39 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1245 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:39.893127 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-49b690fb-27cb-420f-af0f-dbc9e52d6022 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] Calling method '.version_select at 0x7fdd3a664700>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:40.025882 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-49b690fb-27cb-420f-af0f-dbc9e52d6022 tempest-VolumesTestJSON-1772302240 tempest-VolumesTestJSON-1772302240-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.137201 May 10 19:56:40.027324 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 30/64] 10.222.0.57 () {58 vars in 1154 bytes} [Tue May 10 19:56:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:40.229737 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1c782e96-8db0-47da-9901-ae9f959fd9a8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:40.230374 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1c782e96-8db0-47da-9901-ae9f959fd9a8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:40.243810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1c782e96-8db0-47da-9901-ae9f959fd9a8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:40.246589 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1c782e96-8db0-47da-9901-ae9f959fd9a8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:40.247797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1c782e96-8db0-47da-9901-ae9f959fd9a8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:40.248577 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1c782e96-8db0-47da-9901-ae9f959fd9a8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:40.399352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 19:56:40.399853 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 19:56:40.400546 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 19:56:40.400985 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 19:56:40.401546 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 19:56:40.411533 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:40.411993 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:40.413053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:40.413606 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:40.445914 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Getting quotas for project bfb1f4857a6e438e87e546dfd1d8a8b9. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:56:40.453963 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Getting quotas for user 0b7dead8216e4cd59eaa15ad8842e38a and project bfb1f4857a6e438e87e546dfd1d8a8b9. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:56:40.471166 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 19:56:40.474005 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 19:56:40.494588 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1c782e96-8db0-47da-9901-ae9f959fd9a8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:40.506944 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1c782e96-8db0-47da-9901-ae9f959fd9a8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1321 microversion: 2.1 time: 0.281078 May 10 19:56:40.509855 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 31/65] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:40 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:40.525149 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a9f4cbe3-1e40-4e80-861f-ec851d494479 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:40.525704 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a9f4cbe3-1e40-4e80-861f-ec851d494479 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:40.538044 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9f4cbe3-1e40-4e80-861f-ec851d494479 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:40.538556 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9f4cbe3-1e40-4e80-861f-ec851d494479 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:40.539357 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9f4cbe3-1e40-4e80-861f-ec851d494479 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:40.540045 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9f4cbe3-1e40-4e80-861f-ec851d494479 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:40.557658 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f95975d9-c10f-4f86-ab10-1424d792b205 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.100643 May 10 19:56:40.562970 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 35/66] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 19:56:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 19:56:40.588127 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e9ea0539-8068-44e5-bbd8-2dde67b67d9b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:40.590204 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e9ea0539-8068-44e5-bbd8-2dde67b67d9b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:40.685130 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e9ea0539-8068-44e5-bbd8-2dde67b67d9b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:40.700300 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e9ea0539-8068-44e5-bbd8-2dde67b67d9b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1237 microversion: 2.1 time: 0.129949 May 10 19:56:40.701279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 36/67] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:40 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1237 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:56:40.760560 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a9f4cbe3-1e40-4e80-861f-ec851d494479 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:40.768093 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a9f4cbe3-1e40-4e80-861f-ec851d494479 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 0.256875 May 10 19:56:40.782165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 32/68] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:40 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:40.904018 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-57989387-7c7e-463b-a0c9-a460df716ede tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:40.915838 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-57989387-7c7e-463b-a0c9-a460df716ede tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:40.922528 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57989387-7c7e-463b-a0c9-a460df716ede tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:40.923000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57989387-7c7e-463b-a0c9-a460df716ede tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:40.923836 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57989387-7c7e-463b-a0c9-a460df716ede tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:40.924285 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57989387-7c7e-463b-a0c9-a460df716ede tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:41.036691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-57989387-7c7e-463b-a0c9-a460df716ede tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:41.059822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-57989387-7c7e-463b-a0c9-a460df716ede tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1245 microversion: 2.1 time: 0.159550 May 10 19:56:41.060691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 37/69] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:40 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1245 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:41.525506 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7c53533b-5659-4271-8c20-dfe6c9e985fd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:41.526953 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7c53533b-5659-4271-8c20-dfe6c9e985fd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:41.543209 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c53533b-5659-4271-8c20-dfe6c9e985fd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:41.544515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c53533b-5659-4271-8c20-dfe6c9e985fd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:41.547581 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c53533b-5659-4271-8c20-dfe6c9e985fd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:41.550555 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c53533b-5659-4271-8c20-dfe6c9e985fd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:41.723476 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ad3e930d-1d64-426c-900d-db10990747dc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:41.725190 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ad3e930d-1d64-426c-900d-db10990747dc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:41.733151 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad3e930d-1d64-426c-900d-db10990747dc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:41.734083 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad3e930d-1d64-426c-900d-db10990747dc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:41.735313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad3e930d-1d64-426c-900d-db10990747dc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:41.735970 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad3e930d-1d64-426c-900d-db10990747dc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:41.824234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ad3e930d-1d64-426c-900d-db10990747dc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:41.832766 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ad3e930d-1d64-426c-900d-db10990747dc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1241 microversion: 2.1 time: 0.115113 May 10 19:56:41.834581 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 38/70] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:41 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:41.837900 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7c53533b-5659-4271-8c20-dfe6c9e985fd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:41.840128 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-56311e58-c033-4260-b3d1-366cb745ceb1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:41.840970 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-56311e58-c033-4260-b3d1-366cb745ceb1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:41.847300 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56311e58-c033-4260-b3d1-366cb745ceb1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:41.847812 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56311e58-c033-4260-b3d1-366cb745ceb1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:41.848683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56311e58-c033-4260-b3d1-366cb745ceb1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:41.849211 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56311e58-c033-4260-b3d1-366cb745ceb1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:41.857844 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7c53533b-5659-4271-8c20-dfe6c9e985fd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1321 microversion: 2.1 time: 0.329592 May 10 19:56:41.868852 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 33/71] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:41 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:42.064909 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-56311e58-c033-4260-b3d1-366cb745ceb1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:42.077237 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-56311e58-c033-4260-b3d1-366cb745ceb1 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 0.241279 May 10 19:56:42.077728 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5bcb922f-3548-44d5-acda-83b1bf25d193 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:42.080147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5bcb922f-3548-44d5-acda-83b1bf25d193 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:42.082575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 39/72] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:41 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:42.089403 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bcb922f-3548-44d5-acda-83b1bf25d193 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:42.090061 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bcb922f-3548-44d5-acda-83b1bf25d193 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:42.090671 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bcb922f-3548-44d5-acda-83b1bf25d193 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:42.091115 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bcb922f-3548-44d5-acda-83b1bf25d193 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:42.174675 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5bcb922f-3548-44d5-acda-83b1bf25d193 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:42.183292 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5bcb922f-3548-44d5-acda-83b1bf25d193 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1245 microversion: 2.1 time: 0.109428 May 10 19:56:42.194295 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 34/73] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:42 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:42.855392 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7d10d6c0-2f13-4306-87d1-ed4a3313259a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:42.856024 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7d10d6c0-2f13-4306-87d1-ed4a3313259a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:42.865296 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d10d6c0-2f13-4306-87d1-ed4a3313259a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:42.868834 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d10d6c0-2f13-4306-87d1-ed4a3313259a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:42.871223 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d10d6c0-2f13-4306-87d1-ed4a3313259a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:42.871223 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d10d6c0-2f13-4306-87d1-ed4a3313259a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:42.878669 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-67d06d9d-a41c-43ee-b7bd-adb8829c2bdd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:42.880051 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-67d06d9d-a41c-43ee-b7bd-adb8829c2bdd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:42.895538 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-67d06d9d-a41c-43ee-b7bd-adb8829c2bdd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:42.898088 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-67d06d9d-a41c-43ee-b7bd-adb8829c2bdd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:42.900742 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-67d06d9d-a41c-43ee-b7bd-adb8829c2bdd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:42.902929 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-67d06d9d-a41c-43ee-b7bd-adb8829c2bdd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:42.987991 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7d10d6c0-2f13-4306-87d1-ed4a3313259a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:43.003081 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7d10d6c0-2f13-4306-87d1-ed4a3313259a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1233 microversion: 2.1 time: 0.153855 May 10 19:56:43.003634 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 40/74] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:42 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1233 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:43.094399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f6775e98-97dc-49bb-badf-d6cbca7eb999 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:43.095255 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f6775e98-97dc-49bb-badf-d6cbca7eb999 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:43.107044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6775e98-97dc-49bb-badf-d6cbca7eb999 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:43.107757 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6775e98-97dc-49bb-badf-d6cbca7eb999 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:43.108711 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6775e98-97dc-49bb-badf-d6cbca7eb999 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:43.109663 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6775e98-97dc-49bb-badf-d6cbca7eb999 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:43.305718 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f6775e98-97dc-49bb-badf-d6cbca7eb999 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:43.314776 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f6775e98-97dc-49bb-badf-d6cbca7eb999 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 0.224180 May 10 19:56:43.318488 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 41/75] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:43 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:43.324418 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ba78c140-cefb-49ca-837c-dafb25c84997 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:43.325220 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ba78c140-cefb-49ca-837c-dafb25c84997 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:43.326666 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-67d06d9d-a41c-43ee-b7bd-adb8829c2bdd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:43.334024 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba78c140-cefb-49ca-837c-dafb25c84997 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:43.335075 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba78c140-cefb-49ca-837c-dafb25c84997 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:43.336178 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba78c140-cefb-49ca-837c-dafb25c84997 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:43.337754 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-67d06d9d-a41c-43ee-b7bd-adb8829c2bdd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1321 microversion: 2.1 time: 0.460173 May 10 19:56:43.346418 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba78c140-cefb-49ca-837c-dafb25c84997 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:43.347404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 35/76] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:42 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:43.422355 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ba78c140-cefb-49ca-837c-dafb25c84997 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:43.432203 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ba78c140-cefb-49ca-837c-dafb25c84997 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1237 microversion: 2.1 time: 0.112186 May 10 19:56:43.446678 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 42/77] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:43 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1237 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:44.021452 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ef8399ff-65c7-44b7-a5e1-e9a19b3a3934 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:44.022069 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ef8399ff-65c7-44b7-a5e1-e9a19b3a3934 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:44.033782 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ef8399ff-65c7-44b7-a5e1-e9a19b3a3934 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:44.034347 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ef8399ff-65c7-44b7-a5e1-e9a19b3a3934 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:44.035779 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ef8399ff-65c7-44b7-a5e1-e9a19b3a3934 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:44.036231 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ef8399ff-65c7-44b7-a5e1-e9a19b3a3934 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:44.316371 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ef8399ff-65c7-44b7-a5e1-e9a19b3a3934 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:44.337944 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-214850c0-2d56-4dd8-a680-0ffe2790f2c7 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:44.341199 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-214850c0-2d56-4dd8-a680-0ffe2790f2c7 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:44.378054 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ef8399ff-65c7-44b7-a5e1-e9a19b3a3934 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1289 microversion: 2.1 time: 0.360106 May 10 19:56:44.381196 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 36/78] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:44 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1289 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:44.383832 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-214850c0-2d56-4dd8-a680-0ffe2790f2c7 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:44.387371 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-214850c0-2d56-4dd8-a680-0ffe2790f2c7 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:44.388415 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-214850c0-2d56-4dd8-a680-0ffe2790f2c7 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:44.389071 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-214850c0-2d56-4dd8-a680-0ffe2790f2c7 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:44.401328 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dd171b87-8cf4-4c7e-987f-bab1863941f3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:44.402272 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dd171b87-8cf4-4c7e-987f-bab1863941f3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:44.426512 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd171b87-8cf4-4c7e-987f-bab1863941f3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:44.430482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd171b87-8cf4-4c7e-987f-bab1863941f3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:44.431604 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd171b87-8cf4-4c7e-987f-bab1863941f3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:44.434204 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd171b87-8cf4-4c7e-987f-bab1863941f3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:44.795252 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dd171b87-8cf4-4c7e-987f-bab1863941f3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:44.796129 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-214850c0-2d56-4dd8-a680-0ffe2790f2c7 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:44.808874 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dd171b87-8cf4-4c7e-987f-bab1863941f3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1321 microversion: 2.1 time: 0.423720 May 10 19:56:44.810733 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-214850c0-2d56-4dd8-a680-0ffe2790f2c7 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 0.477252 May 10 19:56:44.811930 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 43/79] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:44 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:56:44.829579 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-83abef23-9c32-4606-b9fd-a0d0ad328bdf tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:44.830437 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-83abef23-9c32-4606-b9fd-a0d0ad328bdf tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:44.831235 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 37/80] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:44 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1321 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:44.842249 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-83abef23-9c32-4606-b9fd-a0d0ad328bdf tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:44.842907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-83abef23-9c32-4606-b9fd-a0d0ad328bdf tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:44.843712 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-83abef23-9c32-4606-b9fd-a0d0ad328bdf tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:44.844153 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-83abef23-9c32-4606-b9fd-a0d0ad328bdf tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:44.957830 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-ba6b6a04-0d5a-4458-b8ce-b76ed8e77a99 req-3aca9c53-dba9-4856-aa67-565622afd708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25288128-b7b5-43ff-917b-89fe72235bd5", "tag": "3abf6ad5-d29b-44c9-be95-969586a18e23"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:44.980067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-ba6b6a04-0d5a-4458-b8ce-b76ed8e77a99 req-3aca9c53-dba9-4856-aa67-565622afd708 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:44.980521 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-ba6b6a04-0d5a-4458-b8ce-b76ed8e77a99 req-3aca9c53-dba9-4856-aa67-565622afd708 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:45.026718 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-ba6b6a04-0d5a-4458-b8ce-b76ed8e77a99 req-3aca9c53-dba9-4856-aa67-565622afd708 service nova] Creating event network-changed:3abf6ad5-d29b-44c9-be95-969586a18e23 for instance 25288128-b7b5-43ff-917b-89fe72235bd5 on hv-cinder-84131 May 10 19:56:45.027342 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-ba6b6a04-0d5a-4458-b8ce-b76ed8e77a99 req-3aca9c53-dba9-4856-aa67-565622afd708 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 19:56:45.039533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a61bbd34-0388-4fff-8147-4e184675e459 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:45.040014 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a61bbd34-0388-4fff-8147-4e184675e459 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:45.040983 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a61bbd34-0388-4fff-8147-4e184675e459 None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:45.041324 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a61bbd34-0388-4fff-8147-4e184675e459 None None] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:45.057965 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.compute.rpcapi [None req-a61bbd34-0388-4fff-8147-4e184675e459 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 19:56:45.068316 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a61bbd34-0388-4fff-8147-4e184675e459 None None] Releasing lock "compute-rpcapi-router" {{(pid=117124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 19:56:45.107113 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a61bbd34-0388-4fff-8147-4e184675e459 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274364 May 10 19:56:45.108341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 38/81] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:45.295172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-83abef23-9c32-4606-b9fd-a0d0ad328bdf tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:45.309050 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-83abef23-9c32-4606-b9fd-a0d0ad328bdf tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1301 microversion: 2.1 time: 0.493346 May 10 19:56:45.310934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 44/82] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:44 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1301 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:45.401393 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-454aa812-b7b6-4c2c-ae6d-8f193e7f6911 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:45.402212 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-454aa812-b7b6-4c2c-ae6d-8f193e7f6911 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:45.415141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-454aa812-b7b6-4c2c-ae6d-8f193e7f6911 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:45.415662 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-454aa812-b7b6-4c2c-ae6d-8f193e7f6911 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:45.416578 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-454aa812-b7b6-4c2c-ae6d-8f193e7f6911 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:45.420232 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-454aa812-b7b6-4c2c-ae6d-8f193e7f6911 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:45.714427 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-454aa812-b7b6-4c2c-ae6d-8f193e7f6911 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:45.724048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-454aa812-b7b6-4c2c-ae6d-8f193e7f6911 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1295 microversion: 2.1 time: 0.327354 May 10 19:56:45.726582 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 39/83] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:45 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1295 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:45.833681 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e9f1da57-0d4f-47c8-88bc-e066c49dc96e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:45.835068 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e9f1da57-0d4f-47c8-88bc-e066c49dc96e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:45.847964 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-09a14c51-07c0-4bd5-844f-13471ac0a37d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:45.848697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-09a14c51-07c0-4bd5-844f-13471ac0a37d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:45.858689 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9f1da57-0d4f-47c8-88bc-e066c49dc96e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:45.859345 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9f1da57-0d4f-47c8-88bc-e066c49dc96e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:45.860821 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9f1da57-0d4f-47c8-88bc-e066c49dc96e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:45.861338 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09a14c51-07c0-4bd5-844f-13471ac0a37d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:45.861917 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09a14c51-07c0-4bd5-844f-13471ac0a37d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:45.864604 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9f1da57-0d4f-47c8-88bc-e066c49dc96e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:45.865663 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09a14c51-07c0-4bd5-844f-13471ac0a37d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:45.867388 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09a14c51-07c0-4bd5-844f-13471ac0a37d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:46.259862 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e9f1da57-0d4f-47c8-88bc-e066c49dc96e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:46.279481 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e9f1da57-0d4f-47c8-88bc-e066c49dc96e tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 0.453919 May 10 19:56:46.283731 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 45/84] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:45 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:46.330206 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b983aa6f-990e-46ac-a042-f3d4f4494ca4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:46.331105 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b983aa6f-990e-46ac-a042-f3d4f4494ca4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:46.339301 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b983aa6f-990e-46ac-a042-f3d4f4494ca4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:46.340063 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b983aa6f-990e-46ac-a042-f3d4f4494ca4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:46.341813 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b983aa6f-990e-46ac-a042-f3d4f4494ca4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:46.342450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b983aa6f-990e-46ac-a042-f3d4f4494ca4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:46.489965 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b983aa6f-990e-46ac-a042-f3d4f4494ca4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:46.500924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b983aa6f-990e-46ac-a042-f3d4f4494ca4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1299 microversion: 2.1 time: 0.174255 May 10 19:56:46.503357 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 46/85] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:46 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:46.682913 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-09a14c51-07c0-4bd5-844f-13471ac0a37d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:46.692475 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-09a14c51-07c0-4bd5-844f-13471ac0a37d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1321 microversion: 2.1 time: 0.848386 May 10 19:56:46.693287 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 40/86] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:45 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1321 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:46.743441 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d9bd8dc6-6ebc-4ca0-9053-72554715b923 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:46.744318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d9bd8dc6-6ebc-4ca0-9053-72554715b923 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:46.757357 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9bd8dc6-6ebc-4ca0-9053-72554715b923 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:46.760557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9bd8dc6-6ebc-4ca0-9053-72554715b923 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:46.761639 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9bd8dc6-6ebc-4ca0-9053-72554715b923 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:46.762238 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9bd8dc6-6ebc-4ca0-9053-72554715b923 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:47.033740 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d9bd8dc6-6ebc-4ca0-9053-72554715b923 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:47.046589 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d9bd8dc6-6ebc-4ca0-9053-72554715b923 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1295 microversion: 2.1 time: 0.306954 May 10 19:56:47.060022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 47/87] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:46 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1295 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:47.300272 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a810b344-7a45-43f8-ad31-e1b0a812319d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:47.301445 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a810b344-7a45-43f8-ad31-e1b0a812319d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:47.323032 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a810b344-7a45-43f8-ad31-e1b0a812319d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:47.323501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a810b344-7a45-43f8-ad31-e1b0a812319d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:47.325099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a810b344-7a45-43f8-ad31-e1b0a812319d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:47.328065 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a810b344-7a45-43f8-ad31-e1b0a812319d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:47.381435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-592f4293-2bb3-476f-986d-39922f73a7bd req-051e3de4-1e8e-4b08-a525-21beb10ce7ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6962e593-72bc-41e9-a336-2e87d494085e", "tag": "d9dd365a-a9a9-4924-b77a-0eef389d3972"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:47.397052 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-592f4293-2bb3-476f-986d-39922f73a7bd req-051e3de4-1e8e-4b08-a525-21beb10ce7ca service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:47.414155 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-592f4293-2bb3-476f-986d-39922f73a7bd req-051e3de4-1e8e-4b08-a525-21beb10ce7ca service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:47.431490 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-592f4293-2bb3-476f-986d-39922f73a7bd req-051e3de4-1e8e-4b08-a525-21beb10ce7ca service nova] Creating event network-changed:d9dd365a-a9a9-4924-b77a-0eef389d3972 for instance 6962e593-72bc-41e9-a336-2e87d494085e on hv-cinder-84131 May 10 19:56:47.440965 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-592f4293-2bb3-476f-986d-39922f73a7bd req-051e3de4-1e8e-4b08-a525-21beb10ce7ca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069775 May 10 19:56:47.443118 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 48/88] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:47.523564 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-608c01b7-0773-4305-9579-5767256e709e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:47.524572 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-608c01b7-0773-4305-9579-5767256e709e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:47.545128 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-608c01b7-0773-4305-9579-5767256e709e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:47.547984 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-608c01b7-0773-4305-9579-5767256e709e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:47.549056 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-608c01b7-0773-4305-9579-5767256e709e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:47.552687 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-608c01b7-0773-4305-9579-5767256e709e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:47.923011 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a810b344-7a45-43f8-ad31-e1b0a812319d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:47.937113 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a810b344-7a45-43f8-ad31-e1b0a812319d tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 0.638211 May 10 19:56:47.939431 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 41/89] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:47 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:47.948345 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-557d8401-ae01-436d-856e-5a6918ad4c07 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:47.950241 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-557d8401-ae01-436d-856e-5a6918ad4c07 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:47.977727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-557d8401-ae01-436d-856e-5a6918ad4c07 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:47.977727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-557d8401-ae01-436d-856e-5a6918ad4c07 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:47.977727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-557d8401-ae01-436d-856e-5a6918ad4c07 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:47.978213 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-557d8401-ae01-436d-856e-5a6918ad4c07 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:48.068529 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-608c01b7-0773-4305-9579-5767256e709e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:48.079672 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-608c01b7-0773-4305-9579-5767256e709e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1366 microversion: 2.1 time: 0.561790 May 10 19:56:48.087846 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 49/90] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:47 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1366 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:48.115098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7a4a588b-d901-470c-8627-4d095b82ecdc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:48.117639 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7a4a588b-d901-470c-8627-4d095b82ecdc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:48.132631 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7a4a588b-d901-470c-8627-4d095b82ecdc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:48.133331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7a4a588b-d901-470c-8627-4d095b82ecdc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:48.138649 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7a4a588b-d901-470c-8627-4d095b82ecdc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:48.139680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7a4a588b-d901-470c-8627-4d095b82ecdc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:48.526391 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7a4a588b-d901-470c-8627-4d095b82ecdc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:48.539759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7a4a588b-d901-470c-8627-4d095b82ecdc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.449995 May 10 19:56:48.540352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 50/91] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:48 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:48.728652 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-afe8c4fc-84f2-4bf6-8cdf-9c83d342b1ab req-924c9bd0-6fa5-4921-abd5-11d13fcc36c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c845f562-743f-4236-89b6-eaff7c82e2dd", "name": "network-vif-plugged", "status": "completed", "tag": "489d3fae-f45c-4b37-8432-9a1c0e9e3eec"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:48.739013 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-afe8c4fc-84f2-4bf6-8cdf-9c83d342b1ab req-924c9bd0-6fa5-4921-abd5-11d13fcc36c7 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:48.740769 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-afe8c4fc-84f2-4bf6-8cdf-9c83d342b1ab req-924c9bd0-6fa5-4921-abd5-11d13fcc36c7 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:48.755726 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-afe8c4fc-84f2-4bf6-8cdf-9c83d342b1ab req-924c9bd0-6fa5-4921-abd5-11d13fcc36c7 service nova] Creating event network-vif-plugged:489d3fae-f45c-4b37-8432-9a1c0e9e3eec for instance c845f562-743f-4236-89b6-eaff7c82e2dd on hv-cinder-84131 May 10 19:56:48.762622 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-557d8401-ae01-436d-856e-5a6918ad4c07 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:48.766326 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-afe8c4fc-84f2-4bf6-8cdf-9c83d342b1ab req-924c9bd0-6fa5-4921-abd5-11d13fcc36c7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220746 May 10 19:56:48.767669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 51/92] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:48.775528 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-0abe7758-c0ad-4ec3-9af3-ca44682784ec req-c67e000a-93af-476f-aa3f-7afa56749711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d737aa62-3e89-4485-a6ab-65267418ce57", "tag": "0a9bb9dc-c69c-46b7-952b-c75f126c69a0"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:48.778958 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-557d8401-ae01-436d-856e-5a6918ad4c07 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1321 microversion: 2.1 time: 0.837986 May 10 19:56:48.781349 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 42/93] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:47 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1321 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:48.814786 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-0abe7758-c0ad-4ec3-9af3-ca44682784ec req-c67e000a-93af-476f-aa3f-7afa56749711 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:48.817526 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-0abe7758-c0ad-4ec3-9af3-ca44682784ec req-c67e000a-93af-476f-aa3f-7afa56749711 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:48.839657 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-0abe7758-c0ad-4ec3-9af3-ca44682784ec req-c67e000a-93af-476f-aa3f-7afa56749711 service nova] Creating event network-changed:0a9bb9dc-c69c-46b7-952b-c75f126c69a0 for instance d737aa62-3e89-4485-a6ab-65267418ce57 on hv-cinder-84131 May 10 19:56:48.849712 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-0abe7758-c0ad-4ec3-9af3-ca44682784ec req-c67e000a-93af-476f-aa3f-7afa56749711 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080132 May 10 19:56:48.851927 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 52/94] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:48.955667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5a43d9ae-7937-4259-997b-93c79a233d70 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:48.956393 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5a43d9ae-7937-4259-997b-93c79a233d70 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:48.968700 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a43d9ae-7937-4259-997b-93c79a233d70 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:48.969183 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a43d9ae-7937-4259-997b-93c79a233d70 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:48.972147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a43d9ae-7937-4259-997b-93c79a233d70 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:48.973156 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a43d9ae-7937-4259-997b-93c79a233d70 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:49.107008 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-97833c99-9472-4be8-92bc-87d57e33c577 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:49.107724 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-97833c99-9472-4be8-92bc-87d57e33c577 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:49.121078 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-97833c99-9472-4be8-92bc-87d57e33c577 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:49.121553 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-97833c99-9472-4be8-92bc-87d57e33c577 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:49.122360 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-97833c99-9472-4be8-92bc-87d57e33c577 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:49.124943 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-97833c99-9472-4be8-92bc-87d57e33c577 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:49.563090 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-97833c99-9472-4be8-92bc-87d57e33c577 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:49.571134 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-97833c99-9472-4be8-92bc-87d57e33c577 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1366 microversion: 2.1 time: 0.469980 May 10 19:56:49.571954 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 53/95] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:49 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1366 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:56:49.593469 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2428be69-a86f-4238-8221-6fb0e8e52894 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:49.594092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2428be69-a86f-4238-8221-6fb0e8e52894 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:49.608408 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2428be69-a86f-4238-8221-6fb0e8e52894 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:49.608846 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2428be69-a86f-4238-8221-6fb0e8e52894 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:49.609881 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2428be69-a86f-4238-8221-6fb0e8e52894 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:49.610545 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2428be69-a86f-4238-8221-6fb0e8e52894 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:49.909178 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2428be69-a86f-4238-8221-6fb0e8e52894 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:49.922380 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2428be69-a86f-4238-8221-6fb0e8e52894 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.332770 May 10 19:56:49.923633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 54/96] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:49 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:49.934508 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8808281c-5c86-4da8-b2a8-9043b78b0102 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:49.935359 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8808281c-5c86-4da8-b2a8-9043b78b0102 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:49.941257 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8808281c-5c86-4da8-b2a8-9043b78b0102 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:49.941707 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8808281c-5c86-4da8-b2a8-9043b78b0102 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:49.942698 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8808281c-5c86-4da8-b2a8-9043b78b0102 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:49.943278 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8808281c-5c86-4da8-b2a8-9043b78b0102 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:50.002238 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5a43d9ae-7937-4259-997b-93c79a233d70 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:50.015906 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5a43d9ae-7937-4259-997b-93c79a233d70 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 1.065173 May 10 19:56:50.023019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 43/97] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:48 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:50.414695 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8808281c-5c86-4da8-b2a8-9043b78b0102 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:50.428969 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8808281c-5c86-4da8-b2a8-9043b78b0102 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1321 microversion: 2.1 time: 0.499968 May 10 19:56:50.432977 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 55/98] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:49 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:50.589218 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-50ef860f-9f1c-4b4a-b395-5cf7276ea8a7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:50.589873 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-50ef860f-9f1c-4b4a-b395-5cf7276ea8a7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:50.599551 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-50ef860f-9f1c-4b4a-b395-5cf7276ea8a7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:50.601403 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-50ef860f-9f1c-4b4a-b395-5cf7276ea8a7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:50.605766 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-50ef860f-9f1c-4b4a-b395-5cf7276ea8a7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:50.608115 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-50ef860f-9f1c-4b4a-b395-5cf7276ea8a7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:50.943083 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cacf1975-9c77-4a2e-a9a3-413c9b66f8cc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:50.943881 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cacf1975-9c77-4a2e-a9a3-413c9b66f8cc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:50.951019 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cacf1975-9c77-4a2e-a9a3-413c9b66f8cc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:50.951682 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cacf1975-9c77-4a2e-a9a3-413c9b66f8cc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:50.952618 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cacf1975-9c77-4a2e-a9a3-413c9b66f8cc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:50.953211 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cacf1975-9c77-4a2e-a9a3-413c9b66f8cc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:51.020106 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-50ef860f-9f1c-4b4a-b395-5cf7276ea8a7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:51.027546 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-50ef860f-9f1c-4b4a-b395-5cf7276ea8a7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1366 microversion: 2.1 time: 0.442533 May 10 19:56:51.036023 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 44/99] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:50 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1366 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:56:51.041178 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5ff58914-fbeb-4fe5-8dff-cc12e123739a tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:51.042034 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5ff58914-fbeb-4fe5-8dff-cc12e123739a tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:51.049337 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ff58914-fbeb-4fe5-8dff-cc12e123739a tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:51.050023 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ff58914-fbeb-4fe5-8dff-cc12e123739a tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:51.051538 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ff58914-fbeb-4fe5-8dff-cc12e123739a tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:51.052122 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ff58914-fbeb-4fe5-8dff-cc12e123739a tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:51.169003 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cacf1975-9c77-4a2e-a9a3-413c9b66f8cc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:51.182337 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cacf1975-9c77-4a2e-a9a3-413c9b66f8cc tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.246393 May 10 19:56:51.183522 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 56/100] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:50 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:51.451260 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8448246e-d5dc-4cf7-afb9-23f6ccaeaa32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:51.451935 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8448246e-d5dc-4cf7-afb9-23f6ccaeaa32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:51.466853 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8448246e-d5dc-4cf7-afb9-23f6ccaeaa32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:51.467365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8448246e-d5dc-4cf7-afb9-23f6ccaeaa32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:51.468394 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8448246e-d5dc-4cf7-afb9-23f6ccaeaa32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:51.469253 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8448246e-d5dc-4cf7-afb9-23f6ccaeaa32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:51.678055 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5ff58914-fbeb-4fe5-8dff-cc12e123739a tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:51.691131 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5ff58914-fbeb-4fe5-8dff-cc12e123739a tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1314 microversion: 2.1 time: 0.651314 May 10 19:56:51.692651 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 45/101] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:51 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:51.761214 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8448246e-d5dc-4cf7-afb9-23f6ccaeaa32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:51.784184 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8448246e-d5dc-4cf7-afb9-23f6ccaeaa32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1321 microversion: 2.1 time: 0.337622 May 10 19:56:51.797339 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 57/102] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:51 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:56:51.868409 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-640ee0d2-6241-4d49-89ff-cb4269b65ada req-67e421a2-b64e-411c-babc-9fea67194c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25288128-b7b5-43ff-917b-89fe72235bd5", "name": "network-vif-plugged", "status": "completed", "tag": "3abf6ad5-d29b-44c9-be95-969586a18e23"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:51.869145 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-9067e563-1b1c-4f57-87f4-bafa2d5068bc req-825f08e6-b796-4b77-809e-87bbaaa61e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1defef6-465d-4f6b-8217-bf739e977b8f", "tag": "fe5765cf-11a0-4789-8584-2baf84582ea4"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:51.881372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-640ee0d2-6241-4d49-89ff-cb4269b65ada req-67e421a2-b64e-411c-babc-9fea67194c2c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:51.883049 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-640ee0d2-6241-4d49-89ff-cb4269b65ada req-67e421a2-b64e-411c-babc-9fea67194c2c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:51.898116 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-9067e563-1b1c-4f57-87f4-bafa2d5068bc req-825f08e6-b796-4b77-809e-87bbaaa61e74 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:51.898636 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-9067e563-1b1c-4f57-87f4-bafa2d5068bc req-825f08e6-b796-4b77-809e-87bbaaa61e74 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:51.917289 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-640ee0d2-6241-4d49-89ff-cb4269b65ada req-67e421a2-b64e-411c-babc-9fea67194c2c service nova] Creating event network-vif-plugged:3abf6ad5-d29b-44c9-be95-969586a18e23 for instance 25288128-b7b5-43ff-917b-89fe72235bd5 on hv-cinder-84131 May 10 19:56:51.935930 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-640ee0d2-6241-4d49-89ff-cb4269b65ada req-67e421a2-b64e-411c-babc-9fea67194c2c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079671 May 10 19:56:51.936581 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-9067e563-1b1c-4f57-87f4-bafa2d5068bc req-825f08e6-b796-4b77-809e-87bbaaa61e74 service nova] Creating event network-changed:fe5765cf-11a0-4789-8584-2baf84582ea4 for instance c1defef6-465d-4f6b-8217-bf739e977b8f on hv-cinder-84131 May 10 19:56:51.937411 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 46/103] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:51.947108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-9067e563-1b1c-4f57-87f4-bafa2d5068bc req-825f08e6-b796-4b77-809e-87bbaaa61e74 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082901 May 10 19:56:51.948225 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 58/104] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 19:56:52.053372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4efc0f0c-1d44-407a-a016-5ca3a092a00b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:52.054909 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4efc0f0c-1d44-407a-a016-5ca3a092a00b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:52.071381 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4efc0f0c-1d44-407a-a016-5ca3a092a00b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:52.072942 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4efc0f0c-1d44-407a-a016-5ca3a092a00b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:52.073952 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4efc0f0c-1d44-407a-a016-5ca3a092a00b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:52.074666 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4efc0f0c-1d44-407a-a016-5ca3a092a00b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:52.199833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-23e5cab6-cb8f-4688-beaf-4a6172aa6191 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:52.200561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-23e5cab6-cb8f-4688-beaf-4a6172aa6191 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:52.209873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-23e5cab6-cb8f-4688-beaf-4a6172aa6191 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:52.210326 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-23e5cab6-cb8f-4688-beaf-4a6172aa6191 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:52.225631 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-23e5cab6-cb8f-4688-beaf-4a6172aa6191 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:52.226097 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-23e5cab6-cb8f-4688-beaf-4a6172aa6191 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:52.552496 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-23e5cab6-cb8f-4688-beaf-4a6172aa6191 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:52.567004 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-23e5cab6-cb8f-4688-beaf-4a6172aa6191 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.371222 May 10 19:56:52.572088 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 59/105] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:52 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:52.604583 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4efc0f0c-1d44-407a-a016-5ca3a092a00b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:52.613117 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4efc0f0c-1d44-407a-a016-5ca3a092a00b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1366 microversion: 2.1 time: 0.568552 May 10 19:56:52.613701 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 47/106] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:52 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1366 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:52.710573 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6839229e-0b61-4851-9f1e-caacd39889db tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:52.711192 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6839229e-0b61-4851-9f1e-caacd39889db tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:52.717101 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6839229e-0b61-4851-9f1e-caacd39889db tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:52.717554 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6839229e-0b61-4851-9f1e-caacd39889db tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:52.718324 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6839229e-0b61-4851-9f1e-caacd39889db tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:52.718791 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6839229e-0b61-4851-9f1e-caacd39889db tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:52.802647 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d3b768c5-a95d-4c68-93da-b0b333dbf947 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:52.803186 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d3b768c5-a95d-4c68-93da-b0b333dbf947 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:52.809273 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3b768c5-a95d-4c68-93da-b0b333dbf947 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:52.809818 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3b768c5-a95d-4c68-93da-b0b333dbf947 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:52.810737 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3b768c5-a95d-4c68-93da-b0b333dbf947 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:52.811283 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3b768c5-a95d-4c68-93da-b0b333dbf947 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:52.858849 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6839229e-0b61-4851-9f1e-caacd39889db tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:52.869285 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6839229e-0b61-4851-9f1e-caacd39889db tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1500 microversion: 2.1 time: 0.164275 May 10 19:56:52.870329 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 60/107] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:52 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1500 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:52.966804 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d3b768c5-a95d-4c68-93da-b0b333dbf947 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:52.972750 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d3b768c5-a95d-4c68-93da-b0b333dbf947 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1321 microversion: 2.1 time: 0.173976 May 10 19:56:52.973480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 48/108] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:52 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:53.585357 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-91caf89a-8bfb-446d-b70e-0284e5d4709e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:53.586916 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-91caf89a-8bfb-446d-b70e-0284e5d4709e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:53.598037 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91caf89a-8bfb-446d-b70e-0284e5d4709e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:53.598937 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91caf89a-8bfb-446d-b70e-0284e5d4709e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:53.599949 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91caf89a-8bfb-446d-b70e-0284e5d4709e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:53.604969 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91caf89a-8bfb-446d-b70e-0284e5d4709e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:53.632424 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-218c6b16-65ac-4b44-b2a9-6e5a2dc7f902 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:53.633187 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-218c6b16-65ac-4b44-b2a9-6e5a2dc7f902 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:53.640857 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-218c6b16-65ac-4b44-b2a9-6e5a2dc7f902 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:53.643377 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-218c6b16-65ac-4b44-b2a9-6e5a2dc7f902 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:53.644990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-218c6b16-65ac-4b44-b2a9-6e5a2dc7f902 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:53.646367 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-218c6b16-65ac-4b44-b2a9-6e5a2dc7f902 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:53.954550 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-91caf89a-8bfb-446d-b70e-0284e5d4709e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:53.965862 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-91caf89a-8bfb-446d-b70e-0284e5d4709e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.385704 May 10 19:56:53.967568 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 61/109] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:53 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:53.987885 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-b016da50-e264-4876-b9e7-5209381cf211 req-62c468ac-e7f2-4375-9feb-e111f3e86535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6962e593-72bc-41e9-a336-2e87d494085e", "name": "network-vif-plugged", "status": "completed", "tag": "d9dd365a-a9a9-4924-b77a-0eef389d3972"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:54.007521 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-b016da50-e264-4876-b9e7-5209381cf211 req-62c468ac-e7f2-4375-9feb-e111f3e86535 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:54.009724 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-b016da50-e264-4876-b9e7-5209381cf211 req-62c468ac-e7f2-4375-9feb-e111f3e86535 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:54.032382 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-b016da50-e264-4876-b9e7-5209381cf211 req-62c468ac-e7f2-4375-9feb-e111f3e86535 service nova] Creating event network-vif-plugged:d9dd365a-a9a9-4924-b77a-0eef389d3972 for instance 6962e593-72bc-41e9-a336-2e87d494085e on hv-cinder-84131 May 10 19:56:54.042146 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-b016da50-e264-4876-b9e7-5209381cf211 req-62c468ac-e7f2-4375-9feb-e111f3e86535 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057999 May 10 19:56:54.044400 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 62/110] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:54.057347 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-00836ac0-e576-4349-9603-23d074ed8738 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:54.060397 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-00836ac0-e576-4349-9603-23d074ed8738 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:54.068817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00836ac0-e576-4349-9603-23d074ed8738 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:54.069760 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00836ac0-e576-4349-9603-23d074ed8738 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:54.070933 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00836ac0-e576-4349-9603-23d074ed8738 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:54.071561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00836ac0-e576-4349-9603-23d074ed8738 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:54.077462 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-218c6b16-65ac-4b44-b2a9-6e5a2dc7f902 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:54.088481 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-218c6b16-65ac-4b44-b2a9-6e5a2dc7f902 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1366 microversion: 2.1 time: 0.460179 May 10 19:56:54.088989 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 49/111] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:53 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:54.265036 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cc12d816-1b87-4ae2-989b-48945ae02820 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ab4afde-4812-40c4-bfe8-15763ccf5318"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:54.266275 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cc12d816-1b87-4ae2-989b-48945ae02820 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:54.272758 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cc12d816-1b87-4ae2-989b-48945ae02820 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:54.273204 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cc12d816-1b87-4ae2-989b-48945ae02820 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:54.273980 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cc12d816-1b87-4ae2-989b-48945ae02820 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:54.274415 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cc12d816-1b87-4ae2-989b-48945ae02820 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:54.308100 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-00836ac0-e576-4349-9603-23d074ed8738 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:54.326100 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-00836ac0-e576-4349-9603-23d074ed8738 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1321 microversion: 2.1 time: 0.276717 May 10 19:56:54.329155 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 63/112] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:54 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:54.752253 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cc12d816-1b87-4ae2-989b-48945ae02820 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "POST /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490739 May 10 19:56:54.758223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 50/113] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 19:56:54 2022] POST /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 19:56:54.983931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-78dae78f-61af-44fc-9f3b-a8729a84371a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:54.984708 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-78dae78f-61af-44fc-9f3b-a8729a84371a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:54.991589 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-78dae78f-61af-44fc-9f3b-a8729a84371a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:54.997479 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-78dae78f-61af-44fc-9f3b-a8729a84371a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:54.998404 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-78dae78f-61af-44fc-9f3b-a8729a84371a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:54.999231 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-78dae78f-61af-44fc-9f3b-a8729a84371a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:55.111143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-317e6723-ca95-4de2-b47e-4a3e52f00c9c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:55.112375 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-317e6723-ca95-4de2-b47e-4a3e52f00c9c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:55.124697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-317e6723-ca95-4de2-b47e-4a3e52f00c9c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:55.132321 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-317e6723-ca95-4de2-b47e-4a3e52f00c9c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:55.133774 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-317e6723-ca95-4de2-b47e-4a3e52f00c9c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:55.137458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-317e6723-ca95-4de2-b47e-4a3e52f00c9c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:55.288246 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-78dae78f-61af-44fc-9f3b-a8729a84371a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:55.296838 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-78dae78f-61af-44fc-9f3b-a8729a84371a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.316769 May 10 19:56:55.303360 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 64/114] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:54 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:55.351219 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-00fdfb31-90aa-477c-ae7b-d2bd04fbe5d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:55.352139 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-00fdfb31-90aa-477c-ae7b-d2bd04fbe5d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:55.362802 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00fdfb31-90aa-477c-ae7b-d2bd04fbe5d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:55.367083 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00fdfb31-90aa-477c-ae7b-d2bd04fbe5d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:55.368169 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00fdfb31-90aa-477c-ae7b-d2bd04fbe5d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:55.368923 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00fdfb31-90aa-477c-ae7b-d2bd04fbe5d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:55.563895 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-317e6723-ca95-4de2-b47e-4a3e52f00c9c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:55.579558 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-317e6723-ca95-4de2-b47e-4a3e52f00c9c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1366 microversion: 2.1 time: 0.475318 May 10 19:56:55.581590 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 51/115] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:55 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:56:55.639051 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-00fdfb31-90aa-477c-ae7b-d2bd04fbe5d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:55.648935 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-00fdfb31-90aa-477c-ae7b-d2bd04fbe5d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1516 microversion: 2.1 time: 0.303139 May 10 19:56:55.651100 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 65/116] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:55 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1516 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:55.672707 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8ab59109-c353-463c-99e3-172943499607 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:55.673747 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8ab59109-c353-463c-99e3-172943499607 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:55.684346 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8ab59109-c353-463c-99e3-172943499607 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:55.684784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8ab59109-c353-463c-99e3-172943499607 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:55.693705 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8ab59109-c353-463c-99e3-172943499607 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:55.694275 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8ab59109-c353-463c-99e3-172943499607 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:55.750082 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-8ab59109-c353-463c-99e3-172943499607 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lazy-loading 'flavor' on Instance uuid 25288128-b7b5-43ff-917b-89fe72235bd5 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 19:56:55.955928 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8ab59109-c353-463c-99e3-172943499607 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "POST /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5/action" status: 200 len: 32 microversion: 2.1 time: 0.288493 May 10 19:56:55.962304 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 52/117] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 19:56:55 2022] POST /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 19:56:55.968309 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4c8ea78d-5e40-4e7d-b6b9-cb282b1cedc3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:55.969440 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4c8ea78d-5e40-4e7d-b6b9-cb282b1cedc3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:55.980391 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4c8ea78d-5e40-4e7d-b6b9-cb282b1cedc3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:55.982155 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4c8ea78d-5e40-4e7d-b6b9-cb282b1cedc3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:55.983935 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4c8ea78d-5e40-4e7d-b6b9-cb282b1cedc3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:55.985276 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4c8ea78d-5e40-4e7d-b6b9-cb282b1cedc3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:56.216111 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4c8ea78d-5e40-4e7d-b6b9-cb282b1cedc3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:56.226847 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4c8ea78d-5e40-4e7d-b6b9-cb282b1cedc3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.263341 May 10 19:56:56.237142 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 66/118] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:55 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:56.323980 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-631c2646-db0c-49d8-9c36-a53cbdb581b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:56.323980 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-631c2646-db0c-49d8-9c36-a53cbdb581b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:56.336114 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-631c2646-db0c-49d8-9c36-a53cbdb581b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:56.336717 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-631c2646-db0c-49d8-9c36-a53cbdb581b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:56.337987 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-631c2646-db0c-49d8-9c36-a53cbdb581b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:56.338670 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-631c2646-db0c-49d8-9c36-a53cbdb581b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:56.527846 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-631c2646-db0c-49d8-9c36-a53cbdb581b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:56.538217 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-631c2646-db0c-49d8-9c36-a53cbdb581b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.221859 May 10 19:56:56.538833 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 53/119] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:56 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:56.597305 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c0109550-f1fd-4f77-b5fd-bb3ee3e6c687 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:56.597938 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c0109550-f1fd-4f77-b5fd-bb3ee3e6c687 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:56.607379 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0109550-f1fd-4f77-b5fd-bb3ee3e6c687 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:56.607926 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0109550-f1fd-4f77-b5fd-bb3ee3e6c687 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:56.608782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0109550-f1fd-4f77-b5fd-bb3ee3e6c687 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:56.609607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0109550-f1fd-4f77-b5fd-bb3ee3e6c687 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:56.771436 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c0109550-f1fd-4f77-b5fd-bb3ee3e6c687 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:56.779714 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c0109550-f1fd-4f77-b5fd-bb3ee3e6c687 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1366 microversion: 2.1 time: 0.186249 May 10 19:56:56.780400 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 67/120] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:56 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:56:57.245343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0b7a07c3-9558-4bdb-8364-7efdfc3521cb tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:57.246072 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0b7a07c3-9558-4bdb-8364-7efdfc3521cb tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:57.254076 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b7a07c3-9558-4bdb-8364-7efdfc3521cb tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:57.254608 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b7a07c3-9558-4bdb-8364-7efdfc3521cb tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:57.255438 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b7a07c3-9558-4bdb-8364-7efdfc3521cb tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:57.256088 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b7a07c3-9558-4bdb-8364-7efdfc3521cb tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:57.469530 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0b7a07c3-9558-4bdb-8364-7efdfc3521cb tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:57.480281 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0b7a07c3-9558-4bdb-8364-7efdfc3521cb tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.238830 May 10 19:56:57.480870 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 54/121] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:57 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:57.554759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ea66b715-dd57-426e-ac4e-14f2ee060ab7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:57.555374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ea66b715-dd57-426e-ac4e-14f2ee060ab7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:57.563191 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ea66b715-dd57-426e-ac4e-14f2ee060ab7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:57.563695 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ea66b715-dd57-426e-ac4e-14f2ee060ab7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:57.564844 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ea66b715-dd57-426e-ac4e-14f2ee060ab7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:57.565455 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ea66b715-dd57-426e-ac4e-14f2ee060ab7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:57.736867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ea66b715-dd57-426e-ac4e-14f2ee060ab7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:57.773224 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ea66b715-dd57-426e-ac4e-14f2ee060ab7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.222828 May 10 19:56:57.775138 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 68/122] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:57 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:57.795806 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-0dbf67a0-6cb3-4653-9a3b-746c57839b4a req-7c539118-10db-449e-9b9c-1b0b27c9edf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d737aa62-3e89-4485-a6ab-65267418ce57", "name": "network-vif-plugged", "status": "completed", "tag": "0a9bb9dc-c69c-46b7-952b-c75f126c69a0"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:56:57.805761 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d65a5d9b-cd45-4dfb-b7c3-be6cbbed51b5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:57.806998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d65a5d9b-cd45-4dfb-b7c3-be6cbbed51b5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:57.814312 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d65a5d9b-cd45-4dfb-b7c3-be6cbbed51b5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:57.815188 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d65a5d9b-cd45-4dfb-b7c3-be6cbbed51b5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:57.817000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d65a5d9b-cd45-4dfb-b7c3-be6cbbed51b5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:57.817841 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d65a5d9b-cd45-4dfb-b7c3-be6cbbed51b5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:57.819893 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-0dbf67a0-6cb3-4653-9a3b-746c57839b4a req-7c539118-10db-449e-9b9c-1b0b27c9edf3 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:57.820497 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-0dbf67a0-6cb3-4653-9a3b-746c57839b4a req-7c539118-10db-449e-9b9c-1b0b27c9edf3 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:57.846872 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-0dbf67a0-6cb3-4653-9a3b-746c57839b4a req-7c539118-10db-449e-9b9c-1b0b27c9edf3 service nova] Creating event network-vif-plugged:0a9bb9dc-c69c-46b7-952b-c75f126c69a0 for instance d737aa62-3e89-4485-a6ab-65267418ce57 on hv-cinder-84131 May 10 19:56:57.860729 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-0dbf67a0-6cb3-4653-9a3b-746c57839b4a req-7c539118-10db-449e-9b9c-1b0b27c9edf3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068529 May 10 19:56:57.865286 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 55/123] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:56:58.140620 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d65a5d9b-cd45-4dfb-b7c3-be6cbbed51b5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:58.152125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d65a5d9b-cd45-4dfb-b7c3-be6cbbed51b5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1366 microversion: 2.1 time: 0.350182 May 10 19:56:58.152735 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 69/124] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:57 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:58.502057 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7a6ea9ae-ee13-44be-adf5-5e2f467393df tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:58.503580 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7a6ea9ae-ee13-44be-adf5-5e2f467393df tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:58.514196 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7a6ea9ae-ee13-44be-adf5-5e2f467393df tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:58.514196 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7a6ea9ae-ee13-44be-adf5-5e2f467393df tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:58.514196 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7a6ea9ae-ee13-44be-adf5-5e2f467393df tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:58.514196 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7a6ea9ae-ee13-44be-adf5-5e2f467393df tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:58.667022 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7a6ea9ae-ee13-44be-adf5-5e2f467393df tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:58.678682 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7a6ea9ae-ee13-44be-adf5-5e2f467393df tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.183352 May 10 19:56:58.679255 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 56/125] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:58 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:56:58.794506 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-57e9441b-73e7-4227-957c-b4600fc34025 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:58.795797 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-57e9441b-73e7-4227-957c-b4600fc34025 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:58.805584 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57e9441b-73e7-4227-957c-b4600fc34025 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:58.808122 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57e9441b-73e7-4227-957c-b4600fc34025 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:58.808985 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57e9441b-73e7-4227-957c-b4600fc34025 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:58.816798 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57e9441b-73e7-4227-957c-b4600fc34025 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:58.995544 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-57e9441b-73e7-4227-957c-b4600fc34025 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:59.004239 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-57e9441b-73e7-4227-957c-b4600fc34025 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.215480 May 10 19:56:59.004958 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 70/126] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:58 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:59.169425 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-63c531dd-6db4-4559-91f9-46185e8e85dd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:59.170031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-63c531dd-6db4-4559-91f9-46185e8e85dd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:59.176061 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63c531dd-6db4-4559-91f9-46185e8e85dd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:59.176855 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63c531dd-6db4-4559-91f9-46185e8e85dd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:59.177838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63c531dd-6db4-4559-91f9-46185e8e85dd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:59.178506 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63c531dd-6db4-4559-91f9-46185e8e85dd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:59.328140 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-63c531dd-6db4-4559-91f9-46185e8e85dd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:59.337082 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-63c531dd-6db4-4559-91f9-46185e8e85dd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1366 microversion: 2.1 time: 0.171498 May 10 19:56:59.337840 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 57/127] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:59 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:56:59.698653 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cce2c16e-e02d-4b9e-8f53-a8e002242cac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:56:59.699272 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cce2c16e-e02d-4b9e-8f53-a8e002242cac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:56:59.708892 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cce2c16e-e02d-4b9e-8f53-a8e002242cac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:59.709407 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cce2c16e-e02d-4b9e-8f53-a8e002242cac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:59.710279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cce2c16e-e02d-4b9e-8f53-a8e002242cac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:56:59.710647 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cce2c16e-e02d-4b9e-8f53-a8e002242cac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:56:59.844092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cce2c16e-e02d-4b9e-8f53-a8e002242cac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:56:59.851977 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cce2c16e-e02d-4b9e-8f53-a8e002242cac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.158912 May 10 19:56:59.852596 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 71/128] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:56:59 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:00.020217 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-acd381f2-ed5c-4e1c-9e4f-fb59473d529f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:00.020744 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-acd381f2-ed5c-4e1c-9e4f-fb59473d529f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:00.027096 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-acd381f2-ed5c-4e1c-9e4f-fb59473d529f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:00.027555 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-acd381f2-ed5c-4e1c-9e4f-fb59473d529f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:00.028317 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-acd381f2-ed5c-4e1c-9e4f-fb59473d529f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:00.028756 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-acd381f2-ed5c-4e1c-9e4f-fb59473d529f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:00.156941 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-acd381f2-ed5c-4e1c-9e4f-fb59473d529f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:00.164704 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-acd381f2-ed5c-4e1c-9e4f-fb59473d529f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.148436 May 10 19:57:00.165281 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 58/129] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:00 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:00.354089 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-eb2e3792-8d40-48ff-9b34-8c15a68cf039 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:00.354735 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-eb2e3792-8d40-48ff-9b34-8c15a68cf039 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:00.361067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eb2e3792-8d40-48ff-9b34-8c15a68cf039 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:00.361579 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eb2e3792-8d40-48ff-9b34-8c15a68cf039 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:00.362352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eb2e3792-8d40-48ff-9b34-8c15a68cf039 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:00.363457 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eb2e3792-8d40-48ff-9b34-8c15a68cf039 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:00.497832 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-eb2e3792-8d40-48ff-9b34-8c15a68cf039 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:00.505555 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-eb2e3792-8d40-48ff-9b34-8c15a68cf039 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1366 microversion: 2.1 time: 0.155283 May 10 19:57:00.506384 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 72/130] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:00 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:00.868524 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1f36e560-ac8d-426a-a9d5-0f828a9ce14d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:00.869184 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1f36e560-ac8d-426a-a9d5-0f828a9ce14d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:00.875692 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f36e560-ac8d-426a-a9d5-0f828a9ce14d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:00.876144 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f36e560-ac8d-426a-a9d5-0f828a9ce14d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:00.876905 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f36e560-ac8d-426a-a9d5-0f828a9ce14d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:00.877340 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f36e560-ac8d-426a-a9d5-0f828a9ce14d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:01.002426 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1f36e560-ac8d-426a-a9d5-0f828a9ce14d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:01.010185 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1f36e560-ac8d-426a-a9d5-0f828a9ce14d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.145389 May 10 19:57:01.010732 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 59/131] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:00 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:01.181264 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2409a495-a542-4d97-8c73-0095927fa965 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:01.181902 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2409a495-a542-4d97-8c73-0095927fa965 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:01.187655 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2409a495-a542-4d97-8c73-0095927fa965 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:01.188102 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2409a495-a542-4d97-8c73-0095927fa965 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:01.188857 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2409a495-a542-4d97-8c73-0095927fa965 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:01.189284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2409a495-a542-4d97-8c73-0095927fa965 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:01.313742 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2409a495-a542-4d97-8c73-0095927fa965 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:01.321964 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2409a495-a542-4d97-8c73-0095927fa965 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.144550 May 10 19:57:01.322556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 73/132] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:01 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:01.522274 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1f55f4f8-ac5e-47bf-896f-cf97cbd6c430 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:01.522872 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1f55f4f8-ac5e-47bf-896f-cf97cbd6c430 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:01.529208 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f55f4f8-ac5e-47bf-896f-cf97cbd6c430 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:01.529663 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f55f4f8-ac5e-47bf-896f-cf97cbd6c430 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:01.530431 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f55f4f8-ac5e-47bf-896f-cf97cbd6c430 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:01.530893 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f55f4f8-ac5e-47bf-896f-cf97cbd6c430 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:01.656398 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1f55f4f8-ac5e-47bf-896f-cf97cbd6c430 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:01.664103 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1f55f4f8-ac5e-47bf-896f-cf97cbd6c430 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1366 microversion: 2.1 time: 0.145754 May 10 19:57:01.664677 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 60/133] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:01 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:01.871161 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-09df6298-3a2d-4899-951b-3edc895d269f req-c5962c33-7eb1-4312-b720-08eabef998e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1defef6-465d-4f6b-8217-bf739e977b8f", "name": "network-vif-plugged", "status": "completed", "tag": "fe5765cf-11a0-4789-8584-2baf84582ea4"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:57:01.879482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-09df6298-3a2d-4899-951b-3edc895d269f req-c5962c33-7eb1-4312-b720-08eabef998e9 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:01.879901 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-09df6298-3a2d-4899-951b-3edc895d269f req-c5962c33-7eb1-4312-b720-08eabef998e9 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:01.891165 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-09df6298-3a2d-4899-951b-3edc895d269f req-c5962c33-7eb1-4312-b720-08eabef998e9 service nova] Creating event network-vif-plugged:fe5765cf-11a0-4789-8584-2baf84582ea4 for instance c1defef6-465d-4f6b-8217-bf739e977b8f on hv-cinder-84131 May 10 19:57:01.896080 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-09df6298-3a2d-4899-951b-3edc895d269f req-c5962c33-7eb1-4312-b720-08eabef998e9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028529 May 10 19:57:01.897194 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 74/134] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:57:02.027430 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5358dc9e-07f4-44be-a16b-26f82cbd4e45 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:02.028161 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5358dc9e-07f4-44be-a16b-26f82cbd4e45 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:02.034056 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5358dc9e-07f4-44be-a16b-26f82cbd4e45 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:02.035271 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5358dc9e-07f4-44be-a16b-26f82cbd4e45 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:02.036115 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5358dc9e-07f4-44be-a16b-26f82cbd4e45 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:02.036628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5358dc9e-07f4-44be-a16b-26f82cbd4e45 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:02.191812 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5358dc9e-07f4-44be-a16b-26f82cbd4e45 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:02.199073 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5358dc9e-07f4-44be-a16b-26f82cbd4e45 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.175501 May 10 19:57:02.199647 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 61/135] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:02 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:02.338965 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-432647e8-8d54-4a9e-b54c-068805e74a4a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:02.339704 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-432647e8-8d54-4a9e-b54c-068805e74a4a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:02.345614 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-432647e8-8d54-4a9e-b54c-068805e74a4a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:02.346061 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-432647e8-8d54-4a9e-b54c-068805e74a4a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:02.347422 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-432647e8-8d54-4a9e-b54c-068805e74a4a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:02.347873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-432647e8-8d54-4a9e-b54c-068805e74a4a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:02.484321 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-432647e8-8d54-4a9e-b54c-068805e74a4a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:02.491689 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-432647e8-8d54-4a9e-b54c-068805e74a4a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.156925 May 10 19:57:02.492271 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 75/136] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:02 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:02.682812 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6af3b380-2654-4669-adaf-1213635ba494 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:02.683609 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6af3b380-2654-4669-adaf-1213635ba494 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:02.690206 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6af3b380-2654-4669-adaf-1213635ba494 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:02.691201 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6af3b380-2654-4669-adaf-1213635ba494 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:02.691966 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6af3b380-2654-4669-adaf-1213635ba494 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:02.692954 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6af3b380-2654-4669-adaf-1213635ba494 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:02.829541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6af3b380-2654-4669-adaf-1213635ba494 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:02.837152 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6af3b380-2654-4669-adaf-1213635ba494 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1557 microversion: 2.1 time: 0.159840 May 10 19:57:02.837715 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 62/137] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:02 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:02.854364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bdd13bcd-8fc7-404d-9b25-c000bd5bce11 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:02.855066 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bdd13bcd-8fc7-404d-9b25-c000bd5bce11 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:02.861610 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdd13bcd-8fc7-404d-9b25-c000bd5bce11 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:02.862047 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdd13bcd-8fc7-404d-9b25-c000bd5bce11 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:02.863399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdd13bcd-8fc7-404d-9b25-c000bd5bce11 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:02.864033 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdd13bcd-8fc7-404d-9b25-c000bd5bce11 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:02.990956 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bdd13bcd-8fc7-404d-9b25-c000bd5bce11 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140431 May 10 19:57:02.997367 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 76/138] 10.222.0.57 () {58 vars in 1274 bytes} [Tue May 10 19:57:02 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:57:03.215754 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0b6f1945-d0e2-4727-88fa-018e6db8a58d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:03.216376 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0b6f1945-d0e2-4727-88fa-018e6db8a58d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:03.223388 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b6f1945-d0e2-4727-88fa-018e6db8a58d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:03.223942 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b6f1945-d0e2-4727-88fa-018e6db8a58d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:03.224803 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b6f1945-d0e2-4727-88fa-018e6db8a58d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:03.225320 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b6f1945-d0e2-4727-88fa-018e6db8a58d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:03.352497 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0b6f1945-d0e2-4727-88fa-018e6db8a58d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:03.360375 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0b6f1945-d0e2-4727-88fa-018e6db8a58d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.148287 May 10 19:57:03.360962 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 63/139] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:03 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:03.508900 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f56d2950-a9ba-4222-b5be-f3e13917ff12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:03.509513 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f56d2950-a9ba-4222-b5be-f3e13917ff12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:03.515445 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f56d2950-a9ba-4222-b5be-f3e13917ff12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:03.516074 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f56d2950-a9ba-4222-b5be-f3e13917ff12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:03.516842 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f56d2950-a9ba-4222-b5be-f3e13917ff12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:03.517279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f56d2950-a9ba-4222-b5be-f3e13917ff12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:03.853122 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f56d2950-a9ba-4222-b5be-f3e13917ff12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:03.856831 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f56d2950-a9ba-4222-b5be-f3e13917ff12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.352017 May 10 19:57:03.857407 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 77/140] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:03 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:57:04.378692 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e8f73a3f-bf0c-4dac-a45a-dfb5bfb8f0d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:04.379512 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e8f73a3f-bf0c-4dac-a45a-dfb5bfb8f0d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:04.386050 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e8f73a3f-bf0c-4dac-a45a-dfb5bfb8f0d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:04.386528 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e8f73a3f-bf0c-4dac-a45a-dfb5bfb8f0d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:04.387306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e8f73a3f-bf0c-4dac-a45a-dfb5bfb8f0d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:04.387744 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e8f73a3f-bf0c-4dac-a45a-dfb5bfb8f0d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:04.455193 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-c3e1d8a7-67f6-4226-9256-8e93c53ea7aa req-3991d747-de76-45f9-98e3-44f0ad90a21d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d737aa62-3e89-4485-a6ab-65267418ce57", "tag": "0a9bb9dc-c69c-46b7-952b-c75f126c69a0"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:57:04.468316 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-c3e1d8a7-67f6-4226-9256-8e93c53ea7aa req-3991d747-de76-45f9-98e3-44f0ad90a21d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:04.468962 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-c3e1d8a7-67f6-4226-9256-8e93c53ea7aa req-3991d747-de76-45f9-98e3-44f0ad90a21d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:04.484291 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-c3e1d8a7-67f6-4226-9256-8e93c53ea7aa req-3991d747-de76-45f9-98e3-44f0ad90a21d service nova] Creating event network-changed:0a9bb9dc-c69c-46b7-952b-c75f126c69a0 for instance d737aa62-3e89-4485-a6ab-65267418ce57 on hv-cinder-84131 May 10 19:57:04.491743 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-c3e1d8a7-67f6-4226-9256-8e93c53ea7aa req-3991d747-de76-45f9-98e3-44f0ad90a21d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040072 May 10 19:57:04.492997 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 78/141] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:57:04.555035 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e8f73a3f-bf0c-4dac-a45a-dfb5bfb8f0d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:04.562317 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e8f73a3f-bf0c-4dac-a45a-dfb5bfb8f0d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.188147 May 10 19:57:04.562923 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 64/142] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:04 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:04.873807 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fb622ccf-65b7-4d07-8778-0a9756433762 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:04.874671 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fb622ccf-65b7-4d07-8778-0a9756433762 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:04.881364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fb622ccf-65b7-4d07-8778-0a9756433762 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:04.881882 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fb622ccf-65b7-4d07-8778-0a9756433762 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:04.882679 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fb622ccf-65b7-4d07-8778-0a9756433762 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:04.883116 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fb622ccf-65b7-4d07-8778-0a9756433762 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:05.016960 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fb622ccf-65b7-4d07-8778-0a9756433762 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:05.024124 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fb622ccf-65b7-4d07-8778-0a9756433762 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.154779 May 10 19:57:05.024700 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 79/143] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:04 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:05.579809 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-649c4eda-811d-463d-bcaf-831cd5b22c58 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:05.580560 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-649c4eda-811d-463d-bcaf-831cd5b22c58 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:05.587545 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-649c4eda-811d-463d-bcaf-831cd5b22c58 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:05.588122 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-649c4eda-811d-463d-bcaf-831cd5b22c58 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:05.588983 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-649c4eda-811d-463d-bcaf-831cd5b22c58 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:05.589491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-649c4eda-811d-463d-bcaf-831cd5b22c58 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:05.723517 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-649c4eda-811d-463d-bcaf-831cd5b22c58 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:05.730934 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-649c4eda-811d-463d-bcaf-831cd5b22c58 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.155310 May 10 19:57:05.731516 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 65/144] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:05 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:06.041120 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-986b67b1-305a-438a-ad2d-030c398b30df tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:06.041815 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-986b67b1-305a-438a-ad2d-030c398b30df tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:06.047651 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-986b67b1-305a-438a-ad2d-030c398b30df tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:06.048104 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-986b67b1-305a-438a-ad2d-030c398b30df tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:06.048867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-986b67b1-305a-438a-ad2d-030c398b30df tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:06.049302 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-986b67b1-305a-438a-ad2d-030c398b30df tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:06.170851 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-986b67b1-305a-438a-ad2d-030c398b30df tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:06.178164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-986b67b1-305a-438a-ad2d-030c398b30df tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.140788 May 10 19:57:06.178944 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 80/145] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:06 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:06.748645 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1ff32e47-a8f9-45c7-b5b7-31567f259a33 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:06.749263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1ff32e47-a8f9-45c7-b5b7-31567f259a33 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:06.755608 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1ff32e47-a8f9-45c7-b5b7-31567f259a33 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:06.755998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1ff32e47-a8f9-45c7-b5b7-31567f259a33 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:06.756790 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1ff32e47-a8f9-45c7-b5b7-31567f259a33 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:06.757230 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1ff32e47-a8f9-45c7-b5b7-31567f259a33 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:06.881463 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1ff32e47-a8f9-45c7-b5b7-31567f259a33 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:06.888661 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1ff32e47-a8f9-45c7-b5b7-31567f259a33 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.144187 May 10 19:57:06.889229 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 66/146] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:06 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:07.196014 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-01ca7a3c-806c-4fcc-bfcd-5f26f0f3fdf0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:07.196627 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-01ca7a3c-806c-4fcc-bfcd-5f26f0f3fdf0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:07.203160 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01ca7a3c-806c-4fcc-bfcd-5f26f0f3fdf0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:07.203607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01ca7a3c-806c-4fcc-bfcd-5f26f0f3fdf0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:07.204366 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01ca7a3c-806c-4fcc-bfcd-5f26f0f3fdf0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:07.204864 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01ca7a3c-806c-4fcc-bfcd-5f26f0f3fdf0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:07.337712 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-01ca7a3c-806c-4fcc-bfcd-5f26f0f3fdf0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:07.347177 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-01ca7a3c-806c-4fcc-bfcd-5f26f0f3fdf0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.154884 May 10 19:57:07.347845 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 81/147] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:07 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:07.906235 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cf6ee763-299a-4e58-bae8-fe3580f7ccd5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:07.906793 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cf6ee763-299a-4e58-bae8-fe3580f7ccd5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:07.913207 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf6ee763-299a-4e58-bae8-fe3580f7ccd5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:07.913659 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf6ee763-299a-4e58-bae8-fe3580f7ccd5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:07.914425 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf6ee763-299a-4e58-bae8-fe3580f7ccd5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:07.914899 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf6ee763-299a-4e58-bae8-fe3580f7ccd5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:08.038634 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cf6ee763-299a-4e58-bae8-fe3580f7ccd5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:08.046267 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cf6ee763-299a-4e58-bae8-fe3580f7ccd5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.144007 May 10 19:57:08.046874 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 67/148] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:07 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:08.364537 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-34101aa5-1024-4b9e-b388-633ff11964ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:08.365230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-34101aa5-1024-4b9e-b388-633ff11964ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:08.371705 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34101aa5-1024-4b9e-b388-633ff11964ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:08.372222 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34101aa5-1024-4b9e-b388-633ff11964ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:08.373067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34101aa5-1024-4b9e-b388-633ff11964ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:08.373833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34101aa5-1024-4b9e-b388-633ff11964ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:08.501272 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-34101aa5-1024-4b9e-b388-633ff11964ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:08.508395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-34101aa5-1024-4b9e-b388-633ff11964ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.148326 May 10 19:57:08.508962 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 82/149] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:08 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:09.063719 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-31f1f41a-7282-465d-8469-808ff96c4532 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:09.064273 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-31f1f41a-7282-465d-8469-808ff96c4532 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:09.070567 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-31f1f41a-7282-465d-8469-808ff96c4532 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:09.071026 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-31f1f41a-7282-465d-8469-808ff96c4532 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:09.071794 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-31f1f41a-7282-465d-8469-808ff96c4532 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:09.072234 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-31f1f41a-7282-465d-8469-808ff96c4532 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:09.195457 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-31f1f41a-7282-465d-8469-808ff96c4532 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:09.202681 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-31f1f41a-7282-465d-8469-808ff96c4532 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.142906 May 10 19:57:09.203264 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 68/150] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:09 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:09.524737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-975ef034-16a8-49c5-b3d4-12f6c6b02ddf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:09.525344 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-975ef034-16a8-49c5-b3d4-12f6c6b02ddf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:09.531526 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-975ef034-16a8-49c5-b3d4-12f6c6b02ddf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:09.531972 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-975ef034-16a8-49c5-b3d4-12f6c6b02ddf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:09.532733 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-975ef034-16a8-49c5-b3d4-12f6c6b02ddf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:09.533160 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-975ef034-16a8-49c5-b3d4-12f6c6b02ddf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:09.669152 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-975ef034-16a8-49c5-b3d4-12f6c6b02ddf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:09.676461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-975ef034-16a8-49c5-b3d4-12f6c6b02ddf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.155553 May 10 19:57:09.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 83/151] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:09 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:10.220453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-08927f17-b28b-435b-928f-14384b9cfdae tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:10.221072 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-08927f17-b28b-435b-928f-14384b9cfdae tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:10.227338 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-08927f17-b28b-435b-928f-14384b9cfdae tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:10.227797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-08927f17-b28b-435b-928f-14384b9cfdae tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:10.228569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-08927f17-b28b-435b-928f-14384b9cfdae tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:10.229030 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-08927f17-b28b-435b-928f-14384b9cfdae tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:10.361080 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-08927f17-b28b-435b-928f-14384b9cfdae tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:10.368920 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-08927f17-b28b-435b-928f-14384b9cfdae tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.152339 May 10 19:57:10.369503 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 69/152] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:10 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:10.693058 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b3f9b95a-95c7-4fe9-8f70-2a102f3b2d5c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:10.693611 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b3f9b95a-95c7-4fe9-8f70-2a102f3b2d5c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:10.700746 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3f9b95a-95c7-4fe9-8f70-2a102f3b2d5c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:10.701437 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3f9b95a-95c7-4fe9-8f70-2a102f3b2d5c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:10.702665 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3f9b95a-95c7-4fe9-8f70-2a102f3b2d5c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:10.703497 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3f9b95a-95c7-4fe9-8f70-2a102f3b2d5c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:11.136608 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b3f9b95a-95c7-4fe9-8f70-2a102f3b2d5c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:11.144133 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b3f9b95a-95c7-4fe9-8f70-2a102f3b2d5c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1363 microversion: 2.1 time: 0.454812 May 10 19:57:11.153518 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 84/153] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:10 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1363 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:11.386800 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1b7dadd2-6522-4c08-913d-c7141586b6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:11.387422 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1b7dadd2-6522-4c08-913d-c7141586b6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:11.396801 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b7dadd2-6522-4c08-913d-c7141586b6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:11.397587 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b7dadd2-6522-4c08-913d-c7141586b6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:11.398774 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b7dadd2-6522-4c08-913d-c7141586b6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:11.399511 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b7dadd2-6522-4c08-913d-c7141586b6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:11.562854 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1b7dadd2-6522-4c08-913d-c7141586b6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:11.571560 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1b7dadd2-6522-4c08-913d-c7141586b6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.188890 May 10 19:57:11.572145 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 70/154] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:11 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:12.179403 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-56e37da9-82c9-4b1e-987b-7b84efacfcb5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:12.182511 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-56e37da9-82c9-4b1e-987b-7b84efacfcb5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:12.208695 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56e37da9-82c9-4b1e-987b-7b84efacfcb5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:12.210920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56e37da9-82c9-4b1e-987b-7b84efacfcb5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:12.213572 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2eb1f7d2-94c7-4119-b513-e41c98957891 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:12.214285 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2eb1f7d2-94c7-4119-b513-e41c98957891 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:12.216383 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56e37da9-82c9-4b1e-987b-7b84efacfcb5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:12.218373 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56e37da9-82c9-4b1e-987b-7b84efacfcb5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:12.223671 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2eb1f7d2-94c7-4119-b513-e41c98957891 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:12.224353 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2eb1f7d2-94c7-4119-b513-e41c98957891 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:12.225561 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2eb1f7d2-94c7-4119-b513-e41c98957891 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:12.226496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2eb1f7d2-94c7-4119-b513-e41c98957891 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:12.258635 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2eb1f7d2-94c7-4119-b513-e41c98957891 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 19:57:12.386554 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2eb1f7d2-94c7-4119-b513-e41c98957891 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 204 len: 0 microversion: 2.1 time: 0.176950 May 10 19:57:12.390524 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 71/155] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 19:57:12 2022] DELETE /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 19:57:12.399288 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-82f659c6-8d55-4408-80ad-2402e41661ec tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:12.400266 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-82f659c6-8d55-4408-80ad-2402e41661ec tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:12.410300 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82f659c6-8d55-4408-80ad-2402e41661ec tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:12.410793 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82f659c6-8d55-4408-80ad-2402e41661ec tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:12.412474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82f659c6-8d55-4408-80ad-2402e41661ec tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:12.412932 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82f659c6-8d55-4408-80ad-2402e41661ec tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:12.422940 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-56e37da9-82c9-4b1e-987b-7b84efacfcb5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:12.432063 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-56e37da9-82c9-4b1e-987b-7b84efacfcb5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1548 microversion: 2.1 time: 0.268033 May 10 19:57:12.442874 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 85/156] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:12 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1548 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:12.457529 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e53a7d37-6b7d-497c-b687-86438b0177c7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:12.458382 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e53a7d37-6b7d-497c-b687-86438b0177c7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:12.464805 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e53a7d37-6b7d-497c-b687-86438b0177c7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:12.465408 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e53a7d37-6b7d-497c-b687-86438b0177c7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:12.466352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e53a7d37-6b7d-497c-b687-86438b0177c7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:12.466984 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e53a7d37-6b7d-497c-b687-86438b0177c7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:12.559750 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-82f659c6-8d55-4408-80ad-2402e41661ec tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:12.569700 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-82f659c6-8d55-4408-80ad-2402e41661ec tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1552 microversion: 2.1 time: 0.176981 May 10 19:57:12.570287 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 72/157] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:12 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:12.588504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3fdc43cb-9c38-4e41-ae53-8803131364c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:12.589149 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3fdc43cb-9c38-4e41-ae53-8803131364c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:12.590111 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e53a7d37-6b7d-497c-b687-86438b0177c7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137478 May 10 19:57:12.591231 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 86/158] 10.222.0.57 () {58 vars in 1274 bytes} [Tue May 10 19:57:12 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:57:12.595438 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fdc43cb-9c38-4e41-ae53-8803131364c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:12.595899 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fdc43cb-9c38-4e41-ae53-8803131364c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:12.596817 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fdc43cb-9c38-4e41-ae53-8803131364c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:12.597424 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fdc43cb-9c38-4e41-ae53-8803131364c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:12.901885 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3fdc43cb-9c38-4e41-ae53-8803131364c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:12.910415 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3fdc43cb-9c38-4e41-ae53-8803131364c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.325651 May 10 19:57:12.911025 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 73/159] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:12 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:57:13.587100 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-dd8c2c25-a0c7-4b0f-b8dd-7813879b7189 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:13.587722 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-dd8c2c25-a0c7-4b0f-b8dd-7813879b7189 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:13.598653 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd8c2c25-a0c7-4b0f-b8dd-7813879b7189 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:13.603057 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd8c2c25-a0c7-4b0f-b8dd-7813879b7189 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:13.604087 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd8c2c25-a0c7-4b0f-b8dd-7813879b7189 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:13.604687 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd8c2c25-a0c7-4b0f-b8dd-7813879b7189 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:13.826368 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-dd8c2c25-a0c7-4b0f-b8dd-7813879b7189 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:13.836410 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-dd8c2c25-a0c7-4b0f-b8dd-7813879b7189 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1552 microversion: 2.1 time: 0.253280 May 10 19:57:13.844986 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 87/160] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:13 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1552 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:13.932838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3b3173db-dbec-4f0c-94df-817ba016f274 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:13.934762 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3b3173db-dbec-4f0c-94df-817ba016f274 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:13.955810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b3173db-dbec-4f0c-94df-817ba016f274 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:13.957389 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b3173db-dbec-4f0c-94df-817ba016f274 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:13.961205 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b3173db-dbec-4f0c-94df-817ba016f274 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:13.961751 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b3173db-dbec-4f0c-94df-817ba016f274 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:14.313154 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3b3173db-dbec-4f0c-94df-817ba016f274 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:14.324942 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3b3173db-dbec-4f0c-94df-817ba016f274 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.401312 May 10 19:57:14.326136 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 74/161] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:13 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:14.742376 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-68fe66e4-51d7-40a0-a560-b973f612e6c5 req-6bcda0c0-e481-4106-be99-ce9ce58b436c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1defef6-465d-4f6b-8217-bf739e977b8f", "tag": "fe5765cf-11a0-4789-8584-2baf84582ea4"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:57:14.760504 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-68fe66e4-51d7-40a0-a560-b973f612e6c5 req-6bcda0c0-e481-4106-be99-ce9ce58b436c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:14.761046 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-68fe66e4-51d7-40a0-a560-b973f612e6c5 req-6bcda0c0-e481-4106-be99-ce9ce58b436c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:14.794168 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-68fe66e4-51d7-40a0-a560-b973f612e6c5 req-6bcda0c0-e481-4106-be99-ce9ce58b436c service nova] Creating event network-changed:fe5765cf-11a0-4789-8584-2baf84582ea4 for instance c1defef6-465d-4f6b-8217-bf739e977b8f on hv-cinder-84131 May 10 19:57:14.803816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-68fe66e4-51d7-40a0-a560-b973f612e6c5 req-6bcda0c0-e481-4106-be99-ce9ce58b436c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067829 May 10 19:57:14.804431 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 88/162] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:57:14.862278 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-da7e57d3-cfee-4e1a-a7fe-e973d8699790 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:14.863074 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-da7e57d3-cfee-4e1a-a7fe-e973d8699790 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:14.875275 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-da7e57d3-cfee-4e1a-a7fe-e973d8699790 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:14.878833 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-da7e57d3-cfee-4e1a-a7fe-e973d8699790 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:14.879854 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-da7e57d3-cfee-4e1a-a7fe-e973d8699790 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:14.880630 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-da7e57d3-cfee-4e1a-a7fe-e973d8699790 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:15.234960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-da7e57d3-cfee-4e1a-a7fe-e973d8699790 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:15.252469 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-da7e57d3-cfee-4e1a-a7fe-e973d8699790 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1552 microversion: 2.1 time: 0.394904 May 10 19:57:15.254031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 75/163] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:14 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1552 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:15.341970 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-407f4f8a-2643-4bbf-9693-80c8d28a02d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:15.343227 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-407f4f8a-2643-4bbf-9693-80c8d28a02d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:15.356943 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-407f4f8a-2643-4bbf-9693-80c8d28a02d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:15.360260 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-407f4f8a-2643-4bbf-9693-80c8d28a02d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:15.362139 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-407f4f8a-2643-4bbf-9693-80c8d28a02d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:15.365730 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-407f4f8a-2643-4bbf-9693-80c8d28a02d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:15.634564 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-407f4f8a-2643-4bbf-9693-80c8d28a02d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:15.643814 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-407f4f8a-2643-4bbf-9693-80c8d28a02d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.305932 May 10 19:57:15.648652 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 89/164] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:15 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:16.280042 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9a9bc192-1e1e-4e6d-879e-e82c169e3c03 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:16.281194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9a9bc192-1e1e-4e6d-879e-e82c169e3c03 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:16.292159 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9a9bc192-1e1e-4e6d-879e-e82c169e3c03 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:16.298777 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9a9bc192-1e1e-4e6d-879e-e82c169e3c03 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:16.300135 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9a9bc192-1e1e-4e6d-879e-e82c169e3c03 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:16.300572 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9a9bc192-1e1e-4e6d-879e-e82c169e3c03 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:16.393046 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9a9bc192-1e1e-4e6d-879e-e82c169e3c03 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:16.402081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9a9bc192-1e1e-4e6d-879e-e82c169e3c03 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1510 microversion: 2.1 time: 0.135252 May 10 19:57:16.402944 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 76/165] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:16 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1510 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:16.664838 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-92df6fb9-9877-4a7f-afa3-c441b8651c9d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:16.666547 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-92df6fb9-9877-4a7f-afa3-c441b8651c9d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:16.683245 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-92df6fb9-9877-4a7f-afa3-c441b8651c9d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:16.684158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-92df6fb9-9877-4a7f-afa3-c441b8651c9d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:16.685528 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-92df6fb9-9877-4a7f-afa3-c441b8651c9d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:16.686200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-92df6fb9-9877-4a7f-afa3-c441b8651c9d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:16.828166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-b887b9ed-df37-4f85-a7cc-0fd8ae00fd3c req-74050a67-30fd-4768-85cd-ace97c9096ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c845f562-743f-4236-89b6-eaff7c82e2dd", "name": "network-vif-deleted", "tag": "489d3fae-f45c-4b37-8432-9a1c0e9e3eec"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:57:16.837144 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-b887b9ed-df37-4f85-a7cc-0fd8ae00fd3c req-74050a67-30fd-4768-85cd-ace97c9096ff service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:16.837501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-b887b9ed-df37-4f85-a7cc-0fd8ae00fd3c req-74050a67-30fd-4768-85cd-ace97c9096ff service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:16.853660 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-b887b9ed-df37-4f85-a7cc-0fd8ae00fd3c req-74050a67-30fd-4768-85cd-ace97c9096ff service nova] Creating event network-vif-deleted:489d3fae-f45c-4b37-8432-9a1c0e9e3eec for instance c845f562-743f-4236-89b6-eaff7c82e2dd on hv-cinder-84131 May 10 19:57:16.859452 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-b887b9ed-df37-4f85-a7cc-0fd8ae00fd3c req-74050a67-30fd-4768-85cd-ace97c9096ff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035802 May 10 19:57:16.860273 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 77/166] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:57:16.891520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-92df6fb9-9877-4a7f-afa3-c441b8651c9d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:16.910754 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-92df6fb9-9877-4a7f-afa3-c441b8651c9d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.245524 May 10 19:57:16.910754 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 90/167] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:16 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:17.421047 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-29328b44-2fe2-4687-bf34-194bc6747321 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:17.421750 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-29328b44-2fe2-4687-bf34-194bc6747321 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:17.428400 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29328b44-2fe2-4687-bf34-194bc6747321 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:17.429078 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29328b44-2fe2-4687-bf34-194bc6747321 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:17.430010 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29328b44-2fe2-4687-bf34-194bc6747321 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:17.430645 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29328b44-2fe2-4687-bf34-194bc6747321 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:17.506640 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-29328b44-2fe2-4687-bf34-194bc6747321 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:17.516783 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-29328b44-2fe2-4687-bf34-194bc6747321 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1510 microversion: 2.1 time: 0.099944 May 10 19:57:17.528111 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 78/168] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:17 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1510 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:17.933605 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-779f7488-3895-4fc4-963e-5c274aeb8247 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:17.934222 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-779f7488-3895-4fc4-963e-5c274aeb8247 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:17.941039 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-779f7488-3895-4fc4-963e-5c274aeb8247 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:17.941499 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-779f7488-3895-4fc4-963e-5c274aeb8247 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:17.942313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-779f7488-3895-4fc4-963e-5c274aeb8247 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:17.942783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-779f7488-3895-4fc4-963e-5c274aeb8247 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:18.081786 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-779f7488-3895-4fc4-963e-5c274aeb8247 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:18.089046 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-779f7488-3895-4fc4-963e-5c274aeb8247 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.159246 May 10 19:57:18.098648 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 91/169] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:17 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:18.535852 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-00152f77-0ec6-4314-a881-3fea72fb7dda tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:18.536478 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-00152f77-0ec6-4314-a881-3fea72fb7dda tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:18.543323 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00152f77-0ec6-4314-a881-3fea72fb7dda tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:18.543974 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00152f77-0ec6-4314-a881-3fea72fb7dda tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:18.544902 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00152f77-0ec6-4314-a881-3fea72fb7dda tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:18.545492 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00152f77-0ec6-4314-a881-3fea72fb7dda tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:18.690184 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-00152f77-0ec6-4314-a881-3fea72fb7dda tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3cef4a86dd4b9cb57619148760ba88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b61967dc5c42ceb097f40a01045bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:18.698603 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-00152f77-0ec6-4314-a881-3fea72fb7dda tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 200 len: 1510 microversion: 2.1 time: 0.167100 May 10 19:57:18.704838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 79/170] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:18 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:19.104961 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-71abd19c-592b-4ea0-a54a-63db73e0c6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:19.105572 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-71abd19c-592b-4ea0-a54a-63db73e0c6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:19.111705 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71abd19c-592b-4ea0-a54a-63db73e0c6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:19.112653 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71abd19c-592b-4ea0-a54a-63db73e0c6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:19.113424 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71abd19c-592b-4ea0-a54a-63db73e0c6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:19.113867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71abd19c-592b-4ea0-a54a-63db73e0c6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:19.475144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-71abd19c-592b-4ea0-a54a-63db73e0c6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:19.483984 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-71abd19c-592b-4ea0-a54a-63db73e0c6a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.382725 May 10 19:57:19.484754 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 92/171] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:19 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:19.716343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-24492d74-125e-40d7-944b-08848f5ea884 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:19.716963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-24492d74-125e-40d7-944b-08848f5ea884 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:19.725346 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24492d74-125e-40d7-944b-08848f5ea884 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:19.726140 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24492d74-125e-40d7-944b-08848f5ea884 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:19.727844 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24492d74-125e-40d7-944b-08848f5ea884 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:19.732557 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24492d74-125e-40d7-944b-08848f5ea884 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:19.770019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-24492d74-125e-40d7-944b-08848f5ea884 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] HTTP exception thrown: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-24492d74-125e-40d7-944b-08848f5ea884 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Request method failure captured: May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd HTTP/1.1 May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNdCXYrX0_qTpFDkZlC_1jWycYdff2gBxPlmZuyBCzvCC5KoaHxPsJDc6URXQDPMpr3hLM8fyDzJzySRytuRFHk8Uwm6VXg7OjweeuW2YY6sQFpkbpbXuQcsgrEwXJ5bBYiR3xaPhsEwfvYOOwTtHlB3jZnIKPUdtTy6hFv5NvtwxA May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 25b61967dc5c42ceb097f40a01045bfa May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-DeleteServersTestJSON-680930683 May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 19:57:19.776727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25b61967dc5c42ceb097f40a01045bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_25b61967dc5c42ceb097f40a01045bfa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25b61967dc5c42ceb097f40a01045bfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/25b61967dc5c42ceb097f40a01045bfa"}]}] May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-DeleteServersTestJSON-680930683 May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 25b61967dc5c42ceb097f40a01045bfa May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-DeleteServersTestJSON-680930683 May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-DeleteServersTestJSON-680930683-project May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 7f3cef4a86dd4b9cb57619148760ba88 May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-DeleteServersTestJSON-680930683-project May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:19.778099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': 'c845f562-743f-4236-89b6-eaff7c82e2dd'} May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:57:19.778826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:19.779957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:19.780912 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-24492d74-125e-40d7-944b-08848f5ea884 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Returning 404 to user: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:57:19.780912 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-24492d74-125e-40d7-944b-08848f5ea884 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 404 len: 111 microversion: 2.1 time: 0.066446 May 10 19:57:19.792909 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 80/172] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:19 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 19:57:19.891629 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cc18e7fb-c92b-47b1-a6c1-04d74319ec10 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:19.892629 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cc18e7fb-c92b-47b1-a6c1-04d74319ec10 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:19.898901 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc18e7fb-c92b-47b1-a6c1-04d74319ec10 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:19.899441 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc18e7fb-c92b-47b1-a6c1-04d74319ec10 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:19.900373 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc18e7fb-c92b-47b1-a6c1-04d74319ec10 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:19.900817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc18e7fb-c92b-47b1-a6c1-04d74319ec10 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:19.914191 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-cc18e7fb-c92b-47b1-a6c1-04d74319ec10 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] HTTP exception thrown: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cc18e7fb-c92b-47b1-a6c1-04d74319ec10 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Request method failure captured: May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd/os-volume_attachments HTTP/1.1 May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNdCXYrX0_qTpFDkZlC_1jWycYdff2gBxPlmZuyBCzvCC5KoaHxPsJDc6URXQDPMpr3hLM8fyDzJzySRytuRFHk8Uwm6VXg7OjweeuW2YY6sQFpkbpbXuQcsgrEwXJ5bBYiR3xaPhsEwfvYOOwTtHlB3jZnIKPUdtTy6hFv5NvtwxA May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 25b61967dc5c42ceb097f40a01045bfa May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-DeleteServersTestJSON-680930683 May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 19:57:19.920936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25b61967dc5c42ceb097f40a01045bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_25b61967dc5c42ceb097f40a01045bfa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25b61967dc5c42ceb097f40a01045bfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/25b61967dc5c42ceb097f40a01045bfa"}]}] May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-DeleteServersTestJSON-680930683 May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 25b61967dc5c42ceb097f40a01045bfa May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-DeleteServersTestJSON-680930683 May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-DeleteServersTestJSON-680930683-project May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 7f3cef4a86dd4b9cb57619148760ba88 May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-DeleteServersTestJSON-680930683-project May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:19.922131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'server_id': 'c845f562-743f-4236-89b6-eaff7c82e2dd'} May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:57:19.922808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:19.923894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:19.925539 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cc18e7fb-c92b-47b1-a6c1-04d74319ec10 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Returning 404 to user: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:57:19.925539 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cc18e7fb-c92b-47b1-a6c1-04d74319ec10 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035670 May 10 19:57:19.925539 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 93/173] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 19:57:19 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 19:57:20.501728 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ab38c78e-fd20-4052-9cd6-1ccf023eb410 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:20.502393 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ab38c78e-fd20-4052-9cd6-1ccf023eb410 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:20.508613 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ab38c78e-fd20-4052-9cd6-1ccf023eb410 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:20.509061 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ab38c78e-fd20-4052-9cd6-1ccf023eb410 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:20.510027 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ab38c78e-fd20-4052-9cd6-1ccf023eb410 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:20.510665 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ab38c78e-fd20-4052-9cd6-1ccf023eb410 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:20.682061 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ab38c78e-fd20-4052-9cd6-1ccf023eb410 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:20.689844 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ab38c78e-fd20-4052-9cd6-1ccf023eb410 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.192333 May 10 19:57:20.701882 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 81/174] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:20 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:21.122499 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1a5c9f31-0e9a-4659-8fec-f53b48f605d3 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:21.123979 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1a5c9f31-0e9a-4659-8fec-f53b48f605d3 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:21.139496 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a5c9f31-0e9a-4659-8fec-f53b48f605d3 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:21.142118 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a5c9f31-0e9a-4659-8fec-f53b48f605d3 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:21.144352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a5c9f31-0e9a-4659-8fec-f53b48f605d3 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:21.144885 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a5c9f31-0e9a-4659-8fec-f53b48f605d3 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:21.184922 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-1a5c9f31-0e9a-4659-8fec-f53b48f605d3 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] HTTP exception thrown: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1a5c9f31-0e9a-4659-8fec-f53b48f605d3 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Request method failure captured: May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: DELETE /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd HTTP/1.1 May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNdCXYrX0_qTpFDkZlC_1jWycYdff2gBxPlmZuyBCzvCC5KoaHxPsJDc6URXQDPMpr3hLM8fyDzJzySRytuRFHk8Uwm6VXg7OjweeuW2YY6sQFpkbpbXuQcsgrEwXJ5bBYiR3xaPhsEwfvYOOwTtHlB3jZnIKPUdtTy6hFv5NvtwxA May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 25b61967dc5c42ceb097f40a01045bfa May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-DeleteServersTestJSON-680930683 May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 19:57:21.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25b61967dc5c42ceb097f40a01045bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_25b61967dc5c42ceb097f40a01045bfa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25b61967dc5c42ceb097f40a01045bfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/25b61967dc5c42ceb097f40a01045bfa"}]}] May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-DeleteServersTestJSON-680930683 May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 25b61967dc5c42ceb097f40a01045bfa May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-DeleteServersTestJSON-680930683 May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-DeleteServersTestJSON-680930683-project May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 7f3cef4a86dd4b9cb57619148760ba88 May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-DeleteServersTestJSON-680930683-project May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:21.189471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': 'c845f562-743f-4236-89b6-eaff7c82e2dd'} May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:57:21.190691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:21.191755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:21.192871 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1a5c9f31-0e9a-4659-8fec-f53b48f605d3 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Returning 404 to user: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:57:21.195936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1a5c9f31-0e9a-4659-8fec-f53b48f605d3 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 404 len: 111 microversion: 2.1 time: 0.078487 May 10 19:57:21.197383 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 94/175] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 19:57:21 2022] DELETE /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 19:57:21.204986 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-28e77350-d001-490a-89c7-75d96bc7ea42 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:21.205666 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-28e77350-d001-490a-89c7-75d96bc7ea42 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] [instance: c845f562-743f-4236-89b6-eaff7c82e2dd] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:21.212595 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28e77350-d001-490a-89c7-75d96bc7ea42 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:21.213245 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28e77350-d001-490a-89c7-75d96bc7ea42 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:21.214082 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28e77350-d001-490a-89c7-75d96bc7ea42 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:21.214774 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28e77350-d001-490a-89c7-75d96bc7ea42 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:21.231357 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-28e77350-d001-490a-89c7-75d96bc7ea42 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] HTTP exception thrown: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-28e77350-d001-490a-89c7-75d96bc7ea42 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Request method failure captured: May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd HTTP/1.1 May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNdCXYrX0_qTpFDkZlC_1jWycYdff2gBxPlmZuyBCzvCC5KoaHxPsJDc6URXQDPMpr3hLM8fyDzJzySRytuRFHk8Uwm6VXg7OjweeuW2YY6sQFpkbpbXuQcsgrEwXJ5bBYiR3xaPhsEwfvYOOwTtHlB3jZnIKPUdtTy6hFv5NvtwxA May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 25b61967dc5c42ceb097f40a01045bfa May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-DeleteServersTestJSON-680930683 May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 19:57:21.233632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25b61967dc5c42ceb097f40a01045bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_25b61967dc5c42ceb097f40a01045bfa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25b61967dc5c42ceb097f40a01045bfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/25b61967dc5c42ceb097f40a01045bfa"}]}] May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-DeleteServersTestJSON-680930683 May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 25b61967dc5c42ceb097f40a01045bfa May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-DeleteServersTestJSON-680930683 May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-DeleteServersTestJSON-680930683-project May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 7f3cef4a86dd4b9cb57619148760ba88 May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-DeleteServersTestJSON-680930683-project May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:21.234998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': 'c845f562-743f-4236-89b6-eaff7c82e2dd'} May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:57:21.235674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. May 10 19:57:21.237960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:21.239540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-28e77350-d001-490a-89c7-75d96bc7ea42 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] Returning 404 to user: Instance c845f562-743f-4236-89b6-eaff7c82e2dd could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:57:21.239540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-28e77350-d001-490a-89c7-75d96bc7ea42 tempest-DeleteServersTestJSON-680930683 tempest-DeleteServersTestJSON-680930683-project] 10.222.0.57 "GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd" status: 404 len: 111 microversion: 2.1 time: 0.035585 May 10 19:57:21.241300 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 82/176] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:21 2022] GET /compute/v2.1/servers/c845f562-743f-4236-89b6-eaff7c82e2dd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 19:57:21.709367 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-da53456e-a59d-4777-8944-4b6b94b9c57c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:21.709990 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-da53456e-a59d-4777-8944-4b6b94b9c57c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:21.715985 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da53456e-a59d-4777-8944-4b6b94b9c57c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:21.716434 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da53456e-a59d-4777-8944-4b6b94b9c57c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:21.717199 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da53456e-a59d-4777-8944-4b6b94b9c57c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:21.717634 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da53456e-a59d-4777-8944-4b6b94b9c57c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:21.869561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-da53456e-a59d-4777-8944-4b6b94b9c57c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:21.878354 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-da53456e-a59d-4777-8944-4b6b94b9c57c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.172755 May 10 19:57:21.879044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 95/177] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:21 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:22.897313 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-72803d55-d696-4fbe-bc61-2b3126bc0432 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:22.897927 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-72803d55-d696-4fbe-bc61-2b3126bc0432 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:22.906796 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72803d55-d696-4fbe-bc61-2b3126bc0432 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:22.907502 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72803d55-d696-4fbe-bc61-2b3126bc0432 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:22.908785 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72803d55-d696-4fbe-bc61-2b3126bc0432 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:22.909510 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72803d55-d696-4fbe-bc61-2b3126bc0432 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:23.123924 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-72803d55-d696-4fbe-bc61-2b3126bc0432 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:23.136184 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-72803d55-d696-4fbe-bc61-2b3126bc0432 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.243069 May 10 19:57:23.136781 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 83/178] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:22 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:23.628045 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-13c0f594-d9db-455d-b406-9e94a6aeed82 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Action: 'create', calling method: .version_select at 0x7fdd3942cdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1556815470", "metadata": {"Type": "work"}}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-13c0f594-d9db-455d-b406-9e94a6aeed82 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Request method failure captured: May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 122 May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesOj_NdLjePNwhWyexZZWYSR2UfSrBZXwiWSo5Eo_023JK5A9XbqjbhhiuUu0UVXddM1fn2XOmLyrLCQom1IlBdiMyeMSyCNFzyrfXY1xU8itWvFIungOjiqsVshpZjub6MLc6jRaUaSLKVzA7lTf5R6w_5LmcQhaYfL9VkEhnATS44 May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 19:57:23.639157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_20eb28f8e08e4214b136dadde33c1223", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/20eb28f8e08e4214b136dadde33c1223"}]}] May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: e79c95449c6f4b7491b7373ff546e67b May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1556815470", "metadata": {"Type": "work"}}} May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: May 10 19:57:23.640557 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1556815470', 'metadata': {'Type': 'work'}}}} May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise error May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi '#$%' May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:57:23.641438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 19:57:23.643049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 19:57:23.644219 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 19:57:23.644219 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.644219 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-13c0f594-d9db-455d-b406-9e94a6aeed82 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:57:23.644219 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-13c0f594-d9db-455d-b406-9e94a6aeed82 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.165432 May 10 19:57:23.644744 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 96/179] 10.222.0.57 () {60 vars in 1155 bytes} [Tue May 10 19:57:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 19:57:23.654393 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c1bbf26d-2102-4d21-98be-2af33d1a430f tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Action: 'create', calling method: .version_select at 0x7fdd3a603280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-975185802", "metadata": {"Type": "work"}}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c1bbf26d-2102-4d21-98be-2af33d1a430f tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Request method failure captured: May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 119 May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesOj_NdLjePNwhWyexZZWYSR2UfSrBZXwiWSo5Eo_023JK5A9XbqjbhhiuUu0UVXddM1fn2XOmLyrLCQom1IlBdiMyeMSyCNFzyrfXY1xU8itWvFIungOjiqsVshpZjub6MLc6jRaUaSLKVzA7lTf5R6w_5LmcQhaYfL9VkEhnATS44 May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 19:57:23.657901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_20eb28f8e08e4214b136dadde33c1223", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/20eb28f8e08e4214b136dadde33c1223"}]}] May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: e79c95449c6f4b7491b7373ff546e67b May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-975185802", "metadata": {"Type": "work"}}} May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: May 10 19:57:23.659860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-975185802', 'metadata': {'Type': 'work'}}}} May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise error May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi '0' May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:57:23.660576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 19:57:23.661797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 19:57:23.663473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 19:57:23.663473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.663473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c1bbf26d-2102-4d21-98be-2af33d1a430f tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:57:23.663473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c1bbf26d-2102-4d21-98be-2af33d1a430f tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009642 May 10 19:57:23.663473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 84/180] 10.222.0.57 () {60 vars in 1155 bytes} [Tue May 10 19:57:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 19:57:23.671556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-208c426f-0114-4ffe-a4f9-7b3dbf040a09 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Action: 'create', calling method: .version_select at 0x7fdd393ed430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-48888347", "metadata": {"Type": "work"}}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-208c426f-0114-4ffe-a4f9-7b3dbf040a09 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Request method failure captured: May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 117 May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesOj_NdLjePNwhWyexZZWYSR2UfSrBZXwiWSo5Eo_023JK5A9XbqjbhhiuUu0UVXddM1fn2XOmLyrLCQom1IlBdiMyeMSyCNFzyrfXY1xU8itWvFIungOjiqsVshpZjub6MLc6jRaUaSLKVzA7lTf5R6w_5LmcQhaYfL9VkEhnATS44 May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 19:57:23.673863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_20eb28f8e08e4214b136dadde33c1223", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/20eb28f8e08e4214b136dadde33c1223"}]}] May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: e79c95449c6f4b7491b7373ff546e67b May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-48888347", "metadata": {"Type": "work"}}} May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: May 10 19:57:23.675200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-48888347', 'metadata': {'Type': 'work'}}}} May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise error May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi '' May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:57:23.675891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 19:57:23.677044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 19:57:23.678057 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 19:57:23.678057 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.678057 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-208c426f-0114-4ffe-a4f9-7b3dbf040a09 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:57:23.678057 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-208c426f-0114-4ffe-a4f9-7b3dbf040a09 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007897 May 10 19:57:23.678057 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 97/181] 10.222.0.57 () {60 vars in 1155 bytes} [Tue May 10 19:57:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 19:57:23.688875 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7f84c7fd-ff6e-4849-8955-6ab672307c8d tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Calling method '.version_select at 0x7fdd3a3889d0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:23.730174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-7f84c7fd-ff6e-4849-8955-6ab672307c8d tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] HTTP exception thrown: Volume tempest-invalid-1721970131 could not be found. May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7f84c7fd-ff6e-4849-8955-6ab672307c8d tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Request method failure captured: May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1721970131 HTTP/1.1 May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesOj_NdLjePNwhWyexZZWYSR2UfSrBZXwiWSo5Eo_023JK5A9XbqjbhhiuUu0UVXddM1fn2XOmLyrLCQom1IlBdiMyeMSyCNFzyrfXY1xU8itWvFIungOjiqsVshpZjub6MLc6jRaUaSLKVzA7lTf5R6w_5LmcQhaYfL9VkEhnATS44 May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 19:57:23.733067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_20eb28f8e08e4214b136dadde33c1223", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/20eb28f8e08e4214b136dadde33c1223"}]}] May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: e79c95449c6f4b7491b7373ff546e67b May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Volume tempest-invalid-1721970131 could not be found. May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': 'tempest-invalid-1721970131'} May 10 19:57:23.734306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1721970131 could not be found. (HTTP 404) (Request-ID: req-2085575f-8b9c-4f39-8b0c-7a8e779c4711) May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.735143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 19:57:23.742491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1721970131 could not be found. May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:57:23.743698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1721970131 could not be found. May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1721970131 could not be found. May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7f84c7fd-ff6e-4849-8955-6ab672307c8d tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Returning 404 to user: Volume tempest-invalid-1721970131 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7f84c7fd-ff6e-4849-8955-6ab672307c8d tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1721970131" status: 404 len: 99 microversion: 2.1 time: 0.050946 May 10 19:57:23.744976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 85/182] 10.222.0.57 () {58 vars in 1217 bytes} [Tue May 10 19:57:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1721970131 => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 19:57:23.748454 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1f8b41f0-eb53-4df2-8e60-874589bda46a tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005247 May 10 19:57:23.748978 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 98/183] 10.222.0.57 () {58 vars in 1139 bytes} [Tue May 10 19:57:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 19:57:23.758109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4d4bc3de-f789-461e-8bff-27403b413eab tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003844 May 10 19:57:23.758655 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 86/184] 10.222.0.57 () {58 vars in 1136 bytes} [Tue May 10 19:57:23 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 19:57:23.767312 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-54eb0cb0-17cb-4d66-829d-809ac97dcd75 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Calling method '.version_select at 0x7fdd39578160>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:23.801831 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-54eb0cb0-17cb-4d66-829d-809ac97dcd75 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] HTTP exception thrown: Volume e74395c6-2c67-48ef-8e92-0d358ce5f64c could not be found. May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-54eb0cb0-17cb-4d66-829d-809ac97dcd75 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Request method failure captured: May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: DELETE /compute/v2.1/os-volumes/e74395c6-2c67-48ef-8e92-0d358ce5f64c HTTP/1.1 May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesOj_NdLjePNwhWyexZZWYSR2UfSrBZXwiWSo5Eo_023JK5A9XbqjbhhiuUu0UVXddM1fn2XOmLyrLCQom1IlBdiMyeMSyCNFzyrfXY1xU8itWvFIungOjiqsVshpZjub6MLc6jRaUaSLKVzA7lTf5R6w_5LmcQhaYfL9VkEhnATS44 May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 19:57:23.803936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_20eb28f8e08e4214b136dadde33c1223", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/20eb28f8e08e4214b136dadde33c1223"}]}] May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: e79c95449c6f4b7491b7373ff546e67b May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Volume e74395c6-2c67-48ef-8e92-0d358ce5f64c could not be found. May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': 'e74395c6-2c67-48ef-8e92-0d358ce5f64c'} May 10 19:57:23.805110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e74395c6-2c67-48ef-8e92-0d358ce5f64c could not be found. (HTTP 404) (Request-ID: req-e5dba79c-a35c-4145-8670-768d767b17b5) May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.805861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 19:57:23.806934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e74395c6-2c67-48ef-8e92-0d358ce5f64c could not be found. May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 19:57:23.809931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e74395c6-2c67-48ef-8e92-0d358ce5f64c could not be found. May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e74395c6-2c67-48ef-8e92-0d358ce5f64c could not be found. May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-54eb0cb0-17cb-4d66-829d-809ac97dcd75 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Returning 404 to user: Volume e74395c6-2c67-48ef-8e92-0d358ce5f64c could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-54eb0cb0-17cb-4d66-829d-809ac97dcd75 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/e74395c6-2c67-48ef-8e92-0d358ce5f64c" status: 404 len: 109 microversion: 2.1 time: 0.042158 May 10 19:57:23.812912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 99/185] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 19:57:23 2022] DELETE /compute/v2.1/os-volumes/e74395c6-2c67-48ef-8e92-0d358ce5f64c => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 19:57:23.815726 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-12f11b4f-ae41-4aad-98c1-263208627e98 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Calling method '.version_select at 0x7fdd3a603af0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:23.847230 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-12f11b4f-ae41-4aad-98c1-263208627e98 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] HTTP exception thrown: Volume 1f70ed7f-b0a4-4135-84a7-16ad16f4729f could not be found. May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-12f11b4f-ae41-4aad-98c1-263208627e98 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Request method failure captured: May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/os-volumes/1f70ed7f-b0a4-4135-84a7-16ad16f4729f HTTP/1.1 May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesOj_NdLjePNwhWyexZZWYSR2UfSrBZXwiWSo5Eo_023JK5A9XbqjbhhiuUu0UVXddM1fn2XOmLyrLCQom1IlBdiMyeMSyCNFzyrfXY1xU8itWvFIungOjiqsVshpZjub6MLc6jRaUaSLKVzA7lTf5R6w_5LmcQhaYfL9VkEhnATS44 May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 19:57:23.851990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_20eb28f8e08e4214b136dadde33c1223", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/20eb28f8e08e4214b136dadde33c1223"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/20eb28f8e08e4214b136dadde33c1223"}]}] May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 20eb28f8e08e4214b136dadde33c1223 May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-VolumesNegativeTest-502015677 May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: e79c95449c6f4b7491b7373ff546e67b May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-VolumesNegativeTest-502015677-project May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Volume 1f70ed7f-b0a4-4135-84a7-16ad16f4729f could not be found. May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '1f70ed7f-b0a4-4135-84a7-16ad16f4729f'} May 10 19:57:23.853494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f70ed7f-b0a4-4135-84a7-16ad16f4729f could not be found. (HTTP 404) (Request-ID: req-7bdbb26f-9955-4ffd-aaf8-c58d5e10c277) May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.854356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 19:57:23.855618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f70ed7f-b0a4-4135-84a7-16ad16f4729f could not be found. May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 19:57:23.856848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:57:23.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f70ed7f-b0a4-4135-84a7-16ad16f4729f could not be found. May 10 19:57:23.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:57:23.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:57:23.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:57:23.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:57:23.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:57:23.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:57:23.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f70ed7f-b0a4-4135-84a7-16ad16f4729f could not be found. May 10 19:57:23.858526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:57:23.860551 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-12f11b4f-ae41-4aad-98c1-263208627e98 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] Returning 404 to user: Volume 1f70ed7f-b0a4-4135-84a7-16ad16f4729f could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:57:23.861563 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-12f11b4f-ae41-4aad-98c1-263208627e98 tempest-VolumesNegativeTest-502015677 tempest-VolumesNegativeTest-502015677-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1f70ed7f-b0a4-4135-84a7-16ad16f4729f" status: 404 len: 109 microversion: 2.1 time: 0.049959 May 10 19:57:23.862710 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 87/186] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 19:57:23 2022] GET /compute/v2.1/os-volumes/1f70ed7f-b0a4-4135-84a7-16ad16f4729f => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 19:57:24.160817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2e1b954c-6f19-403f-aa7e-91b4a2d6038e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:24.160817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2e1b954c-6f19-403f-aa7e-91b4a2d6038e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:24.167153 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e1b954c-6f19-403f-aa7e-91b4a2d6038e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:24.167736 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e1b954c-6f19-403f-aa7e-91b4a2d6038e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:24.169034 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e1b954c-6f19-403f-aa7e-91b4a2d6038e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:24.169382 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e1b954c-6f19-403f-aa7e-91b4a2d6038e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:24.381839 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e1b954c-6f19-403f-aa7e-91b4a2d6038e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:24.393013 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2e1b954c-6f19-403f-aa7e-91b4a2d6038e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.243638 May 10 19:57:24.394112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 100/187] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:24 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:25.412233 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0eb47713-781d-4237-9043-d81bbe191559 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:25.412907 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0eb47713-781d-4237-9043-d81bbe191559 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:25.419200 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0eb47713-781d-4237-9043-d81bbe191559 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:25.419680 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0eb47713-781d-4237-9043-d81bbe191559 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:25.420658 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0eb47713-781d-4237-9043-d81bbe191559 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:25.421418 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0eb47713-781d-4237-9043-d81bbe191559 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:25.569906 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0eb47713-781d-4237-9043-d81bbe191559 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:25.577576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0eb47713-781d-4237-9043-d81bbe191559 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.170753 May 10 19:57:25.578150 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 88/188] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:25 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:26.601942 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3b316fd5-ccc1-445e-b4d0-a36faafa442f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:26.603092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3b316fd5-ccc1-445e-b4d0-a36faafa442f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:26.612287 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b316fd5-ccc1-445e-b4d0-a36faafa442f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:26.612752 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b316fd5-ccc1-445e-b4d0-a36faafa442f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:26.613540 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b316fd5-ccc1-445e-b4d0-a36faafa442f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:26.613984 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b316fd5-ccc1-445e-b4d0-a36faafa442f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:26.770327 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3b316fd5-ccc1-445e-b4d0-a36faafa442f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:26.777671 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3b316fd5-ccc1-445e-b4d0-a36faafa442f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.185869 May 10 19:57:26.778880 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 101/189] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:26 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:27.794780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dbf09c3a-4296-45b3-912a-04cc02d1f640 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:27.796125 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dbf09c3a-4296-45b3-912a-04cc02d1f640 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:27.808972 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dbf09c3a-4296-45b3-912a-04cc02d1f640 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:27.809442 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dbf09c3a-4296-45b3-912a-04cc02d1f640 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:27.814555 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dbf09c3a-4296-45b3-912a-04cc02d1f640 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:27.815623 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dbf09c3a-4296-45b3-912a-04cc02d1f640 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:27.955579 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dbf09c3a-4296-45b3-912a-04cc02d1f640 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:27.966853 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dbf09c3a-4296-45b3-912a-04cc02d1f640 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.175391 May 10 19:57:27.969039 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 89/190] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:27 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:28.984722 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6ed10bdc-6812-4c9a-b015-30a6de0b28f9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:28.985630 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6ed10bdc-6812-4c9a-b015-30a6de0b28f9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:28.992294 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6ed10bdc-6812-4c9a-b015-30a6de0b28f9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:28.992837 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6ed10bdc-6812-4c9a-b015-30a6de0b28f9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:28.993667 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6ed10bdc-6812-4c9a-b015-30a6de0b28f9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:28.994223 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6ed10bdc-6812-4c9a-b015-30a6de0b28f9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:29.153888 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6ed10bdc-6812-4c9a-b015-30a6de0b28f9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:29.162747 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6ed10bdc-6812-4c9a-b015-30a6de0b28f9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.181993 May 10 19:57:29.163688 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 102/191] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:28 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:30.181110 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7d86958f-8790-4603-8170-da76c8769f09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:30.181941 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7d86958f-8790-4603-8170-da76c8769f09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:30.195307 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d86958f-8790-4603-8170-da76c8769f09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:30.195307 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d86958f-8790-4603-8170-da76c8769f09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:30.195307 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d86958f-8790-4603-8170-da76c8769f09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:30.195307 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d86958f-8790-4603-8170-da76c8769f09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:30.344136 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7d86958f-8790-4603-8170-da76c8769f09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:30.351475 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7d86958f-8790-4603-8170-da76c8769f09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.174863 May 10 19:57:30.352042 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 90/192] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:30 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:31.369141 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8c91f3c8-bee2-428f-ba93-dee2b68f423a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:31.370302 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8c91f3c8-bee2-428f-ba93-dee2b68f423a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:31.377830 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8c91f3c8-bee2-428f-ba93-dee2b68f423a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:31.378472 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8c91f3c8-bee2-428f-ba93-dee2b68f423a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:31.379672 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8c91f3c8-bee2-428f-ba93-dee2b68f423a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:31.380336 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8c91f3c8-bee2-428f-ba93-dee2b68f423a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:31.562318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8c91f3c8-bee2-428f-ba93-dee2b68f423a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:31.572690 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8c91f3c8-bee2-428f-ba93-dee2b68f423a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.207915 May 10 19:57:31.573281 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 103/193] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:31 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:32.592675 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8b12d83b-5c1c-4b59-ba97-faa172447961 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:32.593437 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8b12d83b-5c1c-4b59-ba97-faa172447961 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:32.600897 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b12d83b-5c1c-4b59-ba97-faa172447961 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:32.601675 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b12d83b-5c1c-4b59-ba97-faa172447961 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:32.602549 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b12d83b-5c1c-4b59-ba97-faa172447961 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:32.603064 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b12d83b-5c1c-4b59-ba97-faa172447961 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:32.801390 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8b12d83b-5c1c-4b59-ba97-faa172447961 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:32.811361 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8b12d83b-5c1c-4b59-ba97-faa172447961 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.223290 May 10 19:57:32.812861 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 91/194] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:32 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:33.827635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e20bd840-28e6-4de4-b4fa-9cfa0bd86d2f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:33.828254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e20bd840-28e6-4de4-b4fa-9cfa0bd86d2f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:33.835035 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e20bd840-28e6-4de4-b4fa-9cfa0bd86d2f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:33.835565 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e20bd840-28e6-4de4-b4fa-9cfa0bd86d2f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:33.836531 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e20bd840-28e6-4de4-b4fa-9cfa0bd86d2f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:33.837047 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e20bd840-28e6-4de4-b4fa-9cfa0bd86d2f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:34.067309 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e20bd840-28e6-4de4-b4fa-9cfa0bd86d2f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:34.080006 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e20bd840-28e6-4de4-b4fa-9cfa0bd86d2f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.255882 May 10 19:57:34.081467 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 104/195] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:33 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:35.097639 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ea0d3532-be5b-49c9-9fc8-177963753f78 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:35.098945 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ea0d3532-be5b-49c9-9fc8-177963753f78 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:35.105305 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea0d3532-be5b-49c9-9fc8-177963753f78 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:35.105785 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea0d3532-be5b-49c9-9fc8-177963753f78 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:35.106584 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea0d3532-be5b-49c9-9fc8-177963753f78 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:35.107020 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea0d3532-be5b-49c9-9fc8-177963753f78 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:35.401009 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ea0d3532-be5b-49c9-9fc8-177963753f78 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:35.411724 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ea0d3532-be5b-49c9-9fc8-177963753f78 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.318496 May 10 19:57:35.412550 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 92/196] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:35 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:36.428725 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6849dddd-cbbb-4c1e-ab67-b798b9f4b22f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:36.429546 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6849dddd-cbbb-4c1e-ab67-b798b9f4b22f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:36.435634 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6849dddd-cbbb-4c1e-ab67-b798b9f4b22f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:36.436082 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6849dddd-cbbb-4c1e-ab67-b798b9f4b22f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:36.436841 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6849dddd-cbbb-4c1e-ab67-b798b9f4b22f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:36.437267 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6849dddd-cbbb-4c1e-ab67-b798b9f4b22f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:36.576064 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6849dddd-cbbb-4c1e-ab67-b798b9f4b22f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:36.583665 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6849dddd-cbbb-4c1e-ab67-b798b9f4b22f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.158782 May 10 19:57:36.584395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 105/197] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:36 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:37.600588 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-18ed7fa5-b309-4c76-9cf0-169e921f085d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:37.601528 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-18ed7fa5-b309-4c76-9cf0-169e921f085d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:37.610137 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-18ed7fa5-b309-4c76-9cf0-169e921f085d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:37.610692 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-18ed7fa5-b309-4c76-9cf0-169e921f085d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:37.611553 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-18ed7fa5-b309-4c76-9cf0-169e921f085d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:37.611988 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-18ed7fa5-b309-4c76-9cf0-169e921f085d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:37.753653 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-18ed7fa5-b309-4c76-9cf0-169e921f085d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:37.760974 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-18ed7fa5-b309-4c76-9cf0-169e921f085d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.164247 May 10 19:57:37.761747 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 93/198] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:37 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:38.779452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-49fb9933-f4b2-4b3f-b079-3c6c85919be7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:38.780882 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-49fb9933-f4b2-4b3f-b079-3c6c85919be7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:38.788038 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49fb9933-f4b2-4b3f-b079-3c6c85919be7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:38.788701 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49fb9933-f4b2-4b3f-b079-3c6c85919be7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:38.790079 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49fb9933-f4b2-4b3f-b079-3c6c85919be7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:38.790710 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49fb9933-f4b2-4b3f-b079-3c6c85919be7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:38.982045 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-49fb9933-f4b2-4b3f-b079-3c6c85919be7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:38.990364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-49fb9933-f4b2-4b3f-b079-3c6c85919be7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.215292 May 10 19:57:38.991005 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 106/199] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:38 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:40.015272 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a0bb4c71-2268-44f6-85ae-8fe1f20d3f19 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:40.019754 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a0bb4c71-2268-44f6-85ae-8fe1f20d3f19 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:40.040823 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a0bb4c71-2268-44f6-85ae-8fe1f20d3f19 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:40.041824 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a0bb4c71-2268-44f6-85ae-8fe1f20d3f19 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:40.043311 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a0bb4c71-2268-44f6-85ae-8fe1f20d3f19 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:40.044050 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a0bb4c71-2268-44f6-85ae-8fe1f20d3f19 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:40.262102 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a0bb4c71-2268-44f6-85ae-8fe1f20d3f19 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:40.284561 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a0bb4c71-2268-44f6-85ae-8fe1f20d3f19 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.279096 May 10 19:57:40.285311 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 94/200] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:40 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:41.304878 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-14cdb919-bf13-42e3-80fb-2c5546340b97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:41.307106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-14cdb919-bf13-42e3-80fb-2c5546340b97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:41.317501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14cdb919-bf13-42e3-80fb-2c5546340b97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:41.318429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14cdb919-bf13-42e3-80fb-2c5546340b97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:41.319537 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14cdb919-bf13-42e3-80fb-2c5546340b97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:41.320575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14cdb919-bf13-42e3-80fb-2c5546340b97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:41.583639 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-14cdb919-bf13-42e3-80fb-2c5546340b97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:41.597344 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-14cdb919-bf13-42e3-80fb-2c5546340b97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.299733 May 10 19:57:41.598259 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 107/201] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:41 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:42.614350 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8a6f8d40-cbad-4f99-9bc1-98085f8a7e2e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:42.615004 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8a6f8d40-cbad-4f99-9bc1-98085f8a7e2e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:42.621241 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8a6f8d40-cbad-4f99-9bc1-98085f8a7e2e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:42.621695 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8a6f8d40-cbad-4f99-9bc1-98085f8a7e2e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:42.622479 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8a6f8d40-cbad-4f99-9bc1-98085f8a7e2e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:42.623226 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8a6f8d40-cbad-4f99-9bc1-98085f8a7e2e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:42.773911 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8a6f8d40-cbad-4f99-9bc1-98085f8a7e2e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:42.781893 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8a6f8d40-cbad-4f99-9bc1-98085f8a7e2e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1522 microversion: 2.1 time: 0.171763 May 10 19:57:42.782850 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 95/202] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:42 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:43.799871 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8f5164a4-caf3-490f-b452-49be62c264fe tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:43.800487 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8f5164a4-caf3-490f-b452-49be62c264fe tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:43.806989 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8f5164a4-caf3-490f-b452-49be62c264fe tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:43.807700 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8f5164a4-caf3-490f-b452-49be62c264fe tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:43.808664 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8f5164a4-caf3-490f-b452-49be62c264fe tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:43.809299 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8f5164a4-caf3-490f-b452-49be62c264fe tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:43.941881 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8f5164a4-caf3-490f-b452-49be62c264fe tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:43.950808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8f5164a4-caf3-490f-b452-49be62c264fe tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1502 microversion: 2.1 time: 0.154776 May 10 19:57:43.951378 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 108/203] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:43 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:43.968305 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-41f409c7-bea3-4f50-8a73-6aaab34e6df3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:43.968857 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-41f409c7-bea3-4f50-8a73-6aaab34e6df3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:43.975881 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41f409c7-bea3-4f50-8a73-6aaab34e6df3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:43.976541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41f409c7-bea3-4f50-8a73-6aaab34e6df3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:43.977334 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41f409c7-bea3-4f50-8a73-6aaab34e6df3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:43.977891 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41f409c7-bea3-4f50-8a73-6aaab34e6df3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:44.145063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-41f409c7-bea3-4f50-8a73-6aaab34e6df3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:44.154566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-41f409c7-bea3-4f50-8a73-6aaab34e6df3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1517 microversion: 2.1 time: 0.190839 May 10 19:57:44.155751 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 96/204] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:43 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:50.918928 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c4e42231-4bfb-4c20-ad47-2389a0a45653 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:57:50.920540 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c4e42231-4bfb-4c20-ad47-2389a0a45653 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:50.927915 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c4e42231-4bfb-4c20-ad47-2389a0a45653 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:50.928617 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c4e42231-4bfb-4c20-ad47-2389a0a45653 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:50.929759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c4e42231-4bfb-4c20-ad47-2389a0a45653 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:50.930206 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c4e42231-4bfb-4c20-ad47-2389a0a45653 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:50.953777 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-c4e42231-4bfb-4c20-ad47-2389a0a45653 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lazy-loading 'flavor' on Instance uuid 6962e593-72bc-41e9-a336-2e87d494085e {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 19:57:51.080016 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c4e42231-4bfb-4c20-ad47-2389a0a45653 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "POST /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e/action" status: 200 len: 32 microversion: 2.1 time: 0.165337 May 10 19:57:51.080682 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 109/205] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 19:57:50 2022] POST /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 19:57:51.090378 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8b14373d-0d5c-41de-91a1-9e570778597e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:51.091032 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8b14373d-0d5c-41de-91a1-9e570778597e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:51.100046 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b14373d-0d5c-41de-91a1-9e570778597e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:51.100727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b14373d-0d5c-41de-91a1-9e570778597e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:51.101520 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b14373d-0d5c-41de-91a1-9e570778597e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:51.101961 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b14373d-0d5c-41de-91a1-9e570778597e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:51.321676 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8b14373d-0d5c-41de-91a1-9e570778597e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:51.329613 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8b14373d-0d5c-41de-91a1-9e570778597e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.243053 May 10 19:57:51.330201 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 97/206] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:51 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:57:52.348450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f7ad81c5-837d-408e-88eb-3a982a1ecc27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:52.349232 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f7ad81c5-837d-408e-88eb-3a982a1ecc27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:52.355616 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f7ad81c5-837d-408e-88eb-3a982a1ecc27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:52.356064 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f7ad81c5-837d-408e-88eb-3a982a1ecc27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:52.356833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f7ad81c5-837d-408e-88eb-3a982a1ecc27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:52.357271 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f7ad81c5-837d-408e-88eb-3a982a1ecc27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:52.483543 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f7ad81c5-837d-408e-88eb-3a982a1ecc27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:52.490889 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f7ad81c5-837d-408e-88eb-3a982a1ecc27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.147335 May 10 19:57:52.491477 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 110/207] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:52 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:53.508808 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-28fd80f6-0e57-4e90-8f0e-5ac5ebbbc3c5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:53.509419 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-28fd80f6-0e57-4e90-8f0e-5ac5ebbbc3c5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:53.515774 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28fd80f6-0e57-4e90-8f0e-5ac5ebbbc3c5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:53.516223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28fd80f6-0e57-4e90-8f0e-5ac5ebbbc3c5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:53.516979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28fd80f6-0e57-4e90-8f0e-5ac5ebbbc3c5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:53.517443 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28fd80f6-0e57-4e90-8f0e-5ac5ebbbc3c5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:53.652917 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-28fd80f6-0e57-4e90-8f0e-5ac5ebbbc3c5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:53.660681 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-28fd80f6-0e57-4e90-8f0e-5ac5ebbbc3c5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.155245 May 10 19:57:53.661257 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 98/208] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:53 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:54.677528 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-804ec506-4aca-4dea-9fbc-f5bc332047c0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:54.678146 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-804ec506-4aca-4dea-9fbc-f5bc332047c0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:54.683985 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-804ec506-4aca-4dea-9fbc-f5bc332047c0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:54.684438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-804ec506-4aca-4dea-9fbc-f5bc332047c0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:54.685206 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-804ec506-4aca-4dea-9fbc-f5bc332047c0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:54.685642 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-804ec506-4aca-4dea-9fbc-f5bc332047c0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:54.814265 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-804ec506-4aca-4dea-9fbc-f5bc332047c0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:54.822090 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-804ec506-4aca-4dea-9fbc-f5bc332047c0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.148863 May 10 19:57:54.822694 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 111/209] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:54 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:55.839179 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f05167f6-d251-4c73-96de-ed87d3b58597 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:55.839703 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f05167f6-d251-4c73-96de-ed87d3b58597 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:55.845907 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f05167f6-d251-4c73-96de-ed87d3b58597 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:55.846359 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f05167f6-d251-4c73-96de-ed87d3b58597 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:55.847150 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f05167f6-d251-4c73-96de-ed87d3b58597 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:55.847653 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f05167f6-d251-4c73-96de-ed87d3b58597 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:55.980105 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f05167f6-d251-4c73-96de-ed87d3b58597 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:55.987445 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f05167f6-d251-4c73-96de-ed87d3b58597 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.152324 May 10 19:57:55.988521 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 99/210] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:55 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:57.005203 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d9b67a23-6f19-478b-9433-dfd92894daa4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:57.005847 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d9b67a23-6f19-478b-9433-dfd92894daa4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:57.011919 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9b67a23-6f19-478b-9433-dfd92894daa4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:57.012380 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9b67a23-6f19-478b-9433-dfd92894daa4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:57.013149 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9b67a23-6f19-478b-9433-dfd92894daa4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:57.013588 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9b67a23-6f19-478b-9433-dfd92894daa4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:57.140958 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d9b67a23-6f19-478b-9433-dfd92894daa4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:57.148578 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d9b67a23-6f19-478b-9433-dfd92894daa4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.147717 May 10 19:57:57.149187 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 112/211] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:56 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:58.166970 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b61418de-e4c1-4b4a-a016-8b25c3db0181 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:58.167570 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b61418de-e4c1-4b4a-a016-8b25c3db0181 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:58.173977 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b61418de-e4c1-4b4a-a016-8b25c3db0181 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:58.174433 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b61418de-e4c1-4b4a-a016-8b25c3db0181 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:58.175295 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b61418de-e4c1-4b4a-a016-8b25c3db0181 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:58.176397 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b61418de-e4c1-4b4a-a016-8b25c3db0181 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:58.305107 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b61418de-e4c1-4b4a-a016-8b25c3db0181 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:58.312486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b61418de-e4c1-4b4a-a016-8b25c3db0181 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.149417 May 10 19:57:58.313055 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 100/212] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:58 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:57:59.329647 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-71c40d59-020f-4b89-b068-7e1ae35da780 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:57:59.331530 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-71c40d59-020f-4b89-b068-7e1ae35da780 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:57:59.338479 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71c40d59-020f-4b89-b068-7e1ae35da780 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:59.338962 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71c40d59-020f-4b89-b068-7e1ae35da780 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:59.339751 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71c40d59-020f-4b89-b068-7e1ae35da780 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:57:59.340184 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71c40d59-020f-4b89-b068-7e1ae35da780 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:57:59.478973 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-71c40d59-020f-4b89-b068-7e1ae35da780 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:57:59.495310 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-71c40d59-020f-4b89-b068-7e1ae35da780 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.169856 May 10 19:57:59.495912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 113/213] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:57:59 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:00.513261 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e2ef11f8-2e7b-4470-8ca7-e46ad5f3a5d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:00.513879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e2ef11f8-2e7b-4470-8ca7-e46ad5f3a5d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:00.520499 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e2ef11f8-2e7b-4470-8ca7-e46ad5f3a5d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:00.520959 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e2ef11f8-2e7b-4470-8ca7-e46ad5f3a5d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:00.521739 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e2ef11f8-2e7b-4470-8ca7-e46ad5f3a5d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:00.522182 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e2ef11f8-2e7b-4470-8ca7-e46ad5f3a5d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:00.648282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e2ef11f8-2e7b-4470-8ca7-e46ad5f3a5d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:00.655505 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e2ef11f8-2e7b-4470-8ca7-e46ad5f3a5d4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.146420 May 10 19:58:00.656073 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 101/214] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:00 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:01.672337 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d3881346-16a7-43c7-9930-f752cc0d1e9b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:01.672862 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d3881346-16a7-43c7-9930-f752cc0d1e9b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:01.679009 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d3881346-16a7-43c7-9930-f752cc0d1e9b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:01.679464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d3881346-16a7-43c7-9930-f752cc0d1e9b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:01.680240 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d3881346-16a7-43c7-9930-f752cc0d1e9b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:01.680682 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d3881346-16a7-43c7-9930-f752cc0d1e9b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:01.812392 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d3881346-16a7-43c7-9930-f752cc0d1e9b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:01.820158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d3881346-16a7-43c7-9930-f752cc0d1e9b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.151748 May 10 19:58:01.820744 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 114/215] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:01 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:02.836684 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b7939005-3981-435f-9393-1fadbcd8ed24 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:02.837299 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b7939005-3981-435f-9393-1fadbcd8ed24 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:02.843707 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b7939005-3981-435f-9393-1fadbcd8ed24 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:02.844165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b7939005-3981-435f-9393-1fadbcd8ed24 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:02.844942 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b7939005-3981-435f-9393-1fadbcd8ed24 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:02.845393 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b7939005-3981-435f-9393-1fadbcd8ed24 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:02.971949 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b7939005-3981-435f-9393-1fadbcd8ed24 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:02.979876 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b7939005-3981-435f-9393-1fadbcd8ed24 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.147002 May 10 19:58:02.980507 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 102/216] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:02 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:03.996782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-42f828d5-b4e2-4904-9488-5f58ec55cc62 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:03.997425 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-42f828d5-b4e2-4904-9488-5f58ec55cc62 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:04.003633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-42f828d5-b4e2-4904-9488-5f58ec55cc62 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:04.004085 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-42f828d5-b4e2-4904-9488-5f58ec55cc62 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:04.005399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-42f828d5-b4e2-4904-9488-5f58ec55cc62 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:04.005831 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-42f828d5-b4e2-4904-9488-5f58ec55cc62 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:04.133703 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-42f828d5-b4e2-4904-9488-5f58ec55cc62 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:04.142939 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-42f828d5-b4e2-4904-9488-5f58ec55cc62 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.149808 May 10 19:58:04.143549 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 115/217] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:03 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:05.160507 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8bcd8072-02c8-4559-9aa9-702d1503371b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:05.161694 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8bcd8072-02c8-4559-9aa9-702d1503371b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:05.169928 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8bcd8072-02c8-4559-9aa9-702d1503371b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:05.170376 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8bcd8072-02c8-4559-9aa9-702d1503371b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:05.171194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8bcd8072-02c8-4559-9aa9-702d1503371b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:05.171623 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8bcd8072-02c8-4559-9aa9-702d1503371b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:05.302756 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8bcd8072-02c8-4559-9aa9-702d1503371b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:05.310010 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8bcd8072-02c8-4559-9aa9-702d1503371b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.153480 May 10 19:58:05.310604 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 103/218] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:05 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:06.326684 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9df55acb-871b-453e-99b8-f29674a87074 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:06.327338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9df55acb-871b-453e-99b8-f29674a87074 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:06.333801 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9df55acb-871b-453e-99b8-f29674a87074 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:06.334256 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9df55acb-871b-453e-99b8-f29674a87074 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:06.335046 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9df55acb-871b-453e-99b8-f29674a87074 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:06.335485 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9df55acb-871b-453e-99b8-f29674a87074 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:06.460921 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9df55acb-871b-453e-99b8-f29674a87074 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:06.468146 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9df55acb-871b-453e-99b8-f29674a87074 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.145349 May 10 19:58:06.468727 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 116/219] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:06 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:07.484681 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-53e63ceb-a397-483a-8c0f-49f51da14b1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:07.485277 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-53e63ceb-a397-483a-8c0f-49f51da14b1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:07.492091 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-53e63ceb-a397-483a-8c0f-49f51da14b1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:07.492547 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-53e63ceb-a397-483a-8c0f-49f51da14b1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:07.493309 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-53e63ceb-a397-483a-8c0f-49f51da14b1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:07.493744 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-53e63ceb-a397-483a-8c0f-49f51da14b1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:07.628191 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-53e63ceb-a397-483a-8c0f-49f51da14b1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:07.636762 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-53e63ceb-a397-483a-8c0f-49f51da14b1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.155965 May 10 19:58:07.637456 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 104/220] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:07 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:58:08.654626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-672a7292-d1ab-44f8-8124-90aa9698233b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:08.655236 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-672a7292-d1ab-44f8-8124-90aa9698233b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:08.661689 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-672a7292-d1ab-44f8-8124-90aa9698233b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:08.662125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-672a7292-d1ab-44f8-8124-90aa9698233b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:08.662913 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-672a7292-d1ab-44f8-8124-90aa9698233b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:08.663346 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-672a7292-d1ab-44f8-8124-90aa9698233b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:08.788193 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-672a7292-d1ab-44f8-8124-90aa9698233b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:08.795439 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-672a7292-d1ab-44f8-8124-90aa9698233b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.144982 May 10 19:58:08.796216 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 117/221] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:08 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:58:09.813515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fcee1479-68ef-4cc7-bbe6-f42fcce862a2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:09.814132 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fcee1479-68ef-4cc7-bbe6-f42fcce862a2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:09.820595 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fcee1479-68ef-4cc7-bbe6-f42fcce862a2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:09.821168 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fcee1479-68ef-4cc7-bbe6-f42fcce862a2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:09.821846 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fcee1479-68ef-4cc7-bbe6-f42fcce862a2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:09.822310 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fcee1479-68ef-4cc7-bbe6-f42fcce862a2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:09.954435 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fcee1479-68ef-4cc7-bbe6-f42fcce862a2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:09.961819 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fcee1479-68ef-4cc7-bbe6-f42fcce862a2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.152434 May 10 19:58:09.962403 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 105/222] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:09 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:10.979102 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-317f32c3-c3b6-4cf7-8856-0f60984097fc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:10.979713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-317f32c3-c3b6-4cf7-8856-0f60984097fc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:10.988628 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-317f32c3-c3b6-4cf7-8856-0f60984097fc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:10.993559 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-317f32c3-c3b6-4cf7-8856-0f60984097fc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:10.994365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-317f32c3-c3b6-4cf7-8856-0f60984097fc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:10.994840 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-317f32c3-c3b6-4cf7-8856-0f60984097fc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:11.118799 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-317f32c3-c3b6-4cf7-8856-0f60984097fc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:11.126704 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-317f32c3-c3b6-4cf7-8856-0f60984097fc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.151354 May 10 19:58:11.127298 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 118/223] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:10 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:12.144276 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-38a2df8e-7b30-4cc1-b014-d08fd27634aa tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:12.144922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-38a2df8e-7b30-4cc1-b014-d08fd27634aa tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:12.151760 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-38a2df8e-7b30-4cc1-b014-d08fd27634aa tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:12.152217 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-38a2df8e-7b30-4cc1-b014-d08fd27634aa tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:12.152982 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-38a2df8e-7b30-4cc1-b014-d08fd27634aa tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:12.153423 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-38a2df8e-7b30-4cc1-b014-d08fd27634aa tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:12.276517 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-38a2df8e-7b30-4cc1-b014-d08fd27634aa tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:12.283833 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-38a2df8e-7b30-4cc1-b014-d08fd27634aa tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.143405 May 10 19:58:12.284409 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 106/224] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:12 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:13.300027 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cf56d0ee-71cd-49fe-8e36-9d6c2f0cbf5e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:13.300546 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cf56d0ee-71cd-49fe-8e36-9d6c2f0cbf5e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:13.307720 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf56d0ee-71cd-49fe-8e36-9d6c2f0cbf5e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:13.308971 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf56d0ee-71cd-49fe-8e36-9d6c2f0cbf5e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:13.309779 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf56d0ee-71cd-49fe-8e36-9d6c2f0cbf5e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:13.310235 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf56d0ee-71cd-49fe-8e36-9d6c2f0cbf5e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:13.438901 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cf56d0ee-71cd-49fe-8e36-9d6c2f0cbf5e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:13.446309 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cf56d0ee-71cd-49fe-8e36-9d6c2f0cbf5e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.150286 May 10 19:58:13.446969 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 119/225] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:13 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:14.465316 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dc8cf9ec-e9c4-4e74-af4b-5ae967ebb8db tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:14.465946 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dc8cf9ec-e9c4-4e74-af4b-5ae967ebb8db tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:14.474362 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc8cf9ec-e9c4-4e74-af4b-5ae967ebb8db tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:14.474856 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc8cf9ec-e9c4-4e74-af4b-5ae967ebb8db tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:14.475642 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc8cf9ec-e9c4-4e74-af4b-5ae967ebb8db tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:14.476089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc8cf9ec-e9c4-4e74-af4b-5ae967ebb8db tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:14.645468 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dc8cf9ec-e9c4-4e74-af4b-5ae967ebb8db tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:14.653094 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dc8cf9ec-e9c4-4e74-af4b-5ae967ebb8db tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.191623 May 10 19:58:14.653677 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 107/226] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:14 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:15.669991 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-dbfafb6e-fe41-4abf-b066-321a910424ba tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:15.670638 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-dbfafb6e-fe41-4abf-b066-321a910424ba tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:15.677401 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dbfafb6e-fe41-4abf-b066-321a910424ba tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:15.677869 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dbfafb6e-fe41-4abf-b066-321a910424ba tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:15.678675 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dbfafb6e-fe41-4abf-b066-321a910424ba tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:15.679123 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dbfafb6e-fe41-4abf-b066-321a910424ba tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:15.819759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-dbfafb6e-fe41-4abf-b066-321a910424ba tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:15.830762 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-dbfafb6e-fe41-4abf-b066-321a910424ba tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.164200 May 10 19:58:15.831800 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 120/227] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:15 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:16.848216 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cdfbc99f-472f-49f4-a933-150b02c82aa8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:16.848832 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cdfbc99f-472f-49f4-a933-150b02c82aa8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:16.855801 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cdfbc99f-472f-49f4-a933-150b02c82aa8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:16.856270 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cdfbc99f-472f-49f4-a933-150b02c82aa8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:16.857052 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cdfbc99f-472f-49f4-a933-150b02c82aa8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:16.857498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cdfbc99f-472f-49f4-a933-150b02c82aa8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:17.000575 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cdfbc99f-472f-49f4-a933-150b02c82aa8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:17.009382 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cdfbc99f-472f-49f4-a933-150b02c82aa8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.165004 May 10 19:58:17.010090 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 108/228] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:16 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:18.039050 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-87d294c3-8d96-4fe5-9aef-0eb3a1fc9ecd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:18.039683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-87d294c3-8d96-4fe5-9aef-0eb3a1fc9ecd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:18.053365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87d294c3-8d96-4fe5-9aef-0eb3a1fc9ecd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:18.053883 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87d294c3-8d96-4fe5-9aef-0eb3a1fc9ecd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:18.054701 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87d294c3-8d96-4fe5-9aef-0eb3a1fc9ecd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:18.055157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87d294c3-8d96-4fe5-9aef-0eb3a1fc9ecd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:18.249084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-87d294c3-8d96-4fe5-9aef-0eb3a1fc9ecd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:18.258336 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-87d294c3-8d96-4fe5-9aef-0eb3a1fc9ecd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.232465 May 10 19:58:18.259173 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 121/229] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:18 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:19.275974 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c9437d22-72be-45b1-bac7-ee94eb876b41 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:19.276513 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c9437d22-72be-45b1-bac7-ee94eb876b41 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:19.283041 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9437d22-72be-45b1-bac7-ee94eb876b41 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:19.283493 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9437d22-72be-45b1-bac7-ee94eb876b41 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:19.284290 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9437d22-72be-45b1-bac7-ee94eb876b41 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:19.284882 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9437d22-72be-45b1-bac7-ee94eb876b41 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:19.445343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c9437d22-72be-45b1-bac7-ee94eb876b41 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:19.452596 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c9437d22-72be-45b1-bac7-ee94eb876b41 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.180563 May 10 19:58:19.457217 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 109/230] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:19 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:20.469663 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-216d2d06-32c8-4baa-9095-ca39bc6ac6b6 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:20.470372 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-216d2d06-32c8-4baa-9095-ca39bc6ac6b6 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:20.476710 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-216d2d06-32c8-4baa-9095-ca39bc6ac6b6 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:20.477165 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-216d2d06-32c8-4baa-9095-ca39bc6ac6b6 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:20.477930 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-216d2d06-32c8-4baa-9095-ca39bc6ac6b6 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:20.478368 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-216d2d06-32c8-4baa-9095-ca39bc6ac6b6 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:20.608654 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-216d2d06-32c8-4baa-9095-ca39bc6ac6b6 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:20.616722 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-216d2d06-32c8-4baa-9095-ca39bc6ac6b6 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1503 microversion: 2.1 time: 0.150900 May 10 19:58:20.626754 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 122/231] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:20 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:20.635122 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f0d60dc8-981b-4233-9de8-bcdfa4c3454b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c29f38c-480d-433b-8080-14e185ae3380"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:20.636341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f0d60dc8-981b-4233-9de8-bcdfa4c3454b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:20.648774 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f0d60dc8-981b-4233-9de8-bcdfa4c3454b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:20.649241 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f0d60dc8-981b-4233-9de8-bcdfa4c3454b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:20.650025 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f0d60dc8-981b-4233-9de8-bcdfa4c3454b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:20.650498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f0d60dc8-981b-4233-9de8-bcdfa4c3454b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:20.676014 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-f0d60dc8-981b-4233-9de8-bcdfa4c3454b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] HTTP exception thrown: Cannot 'attach_volume' instance 6962e593-72bc-41e9-a336-2e87d494085e while it is in vm_state rescued May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f0d60dc8-981b-4233-9de8-bcdfa4c3454b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Request method failure captured: May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: POST /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e/os-volume_attachments HTTP/1.1 May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 74 May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNo04E0Z0Ck85gi8rn8y1lQtBLANGa8h6SePA9luVr3Mh9vwJluzvEZNvMI4J7xpX1FRp5GiMBU2GE0ovFK2LKxd8V93dEh7e7NT9bHjPShmoKFOaY_REigD35dmE73SupGZSHiej8LKf3MbyU9YaRyRdl5a32kmQxXHM4GF-5KxyQ May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 866e5dd5364e4bd980ba03f1b76aac9d May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-900477838 May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 19:58:20.677736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/866e5dd5364e4bd980ba03f1b76aac9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_866e5dd5364e4bd980ba03f1b76aac9d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/866e5dd5364e4bd980ba03f1b76aac9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/866e5dd5364e4bd980ba03f1b76aac9d"}]}] May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-900477838 May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 866e5dd5364e4bd980ba03f1b76aac9d May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-900477838 May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-ServerRescueNegativeTestJSON-900477838-project May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: b642ac529ee043fd894a9188f30ed026 May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-900477838-project May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {"volumeAttachment": {"volumeId": "6c29f38c-480d-433b-8080-14e185ae3380"}} May 10 19:58:20.679258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Cannot 'attach_volume' instance 6962e593-72bc-41e9-a336-2e87d494085e while it is in vm_state rescued May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'server_id': '6962e593-72bc-41e9-a336-2e87d494085e', 'body': {'volumeAttachment': {'volumeId': '6c29f38c-480d-433b-8080-14e185ae3380'}}} May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6962e593-72bc-41e9-a336-2e87d494085e in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:58:20.682922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6962e593-72bc-41e9-a336-2e87d494085e while it is in vm_state rescued May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:58:20.684194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:58:20.685358 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:58:20.685358 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:58:20.685358 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6962e593-72bc-41e9-a336-2e87d494085e while it is in vm_state rescued May 10 19:58:20.685358 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:58:20.685358 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f0d60dc8-981b-4233-9de8-bcdfa4c3454b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Returning 409 to user: Cannot 'attach_volume' instance 6962e593-72bc-41e9-a336-2e87d494085e while it is in vm_state rescued {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:58:20.685358 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f0d60dc8-981b-4233-9de8-bcdfa4c3454b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "POST /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050133 May 10 19:58:20.685358 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 110/232] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 19:58:20 2022] POST /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 19:58:20.691791 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1287a1af-ae5d-488b-b0ae-b9bdb849bd97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:20.692407 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1287a1af-ae5d-488b-b0ae-b9bdb849bd97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:20.698300 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1287a1af-ae5d-488b-b0ae-b9bdb849bd97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:20.698695 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1287a1af-ae5d-488b-b0ae-b9bdb849bd97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:20.699464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1287a1af-ae5d-488b-b0ae-b9bdb849bd97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:20.699905 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1287a1af-ae5d-488b-b0ae-b9bdb849bd97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:20.767354 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1287a1af-ae5d-488b-b0ae-b9bdb849bd97 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "POST /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e/action" status: 202 len: 0 microversion: 2.1 time: 0.079785 May 10 19:58:20.768495 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 123/233] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 19:58:20 2022] POST /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 19:58:20.782653 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c91e6d7f-379c-4639-a89f-ef4308cf8c6f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:20.783408 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c91e6d7f-379c-4639-a89f-ef4308cf8c6f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:20.791932 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c91e6d7f-379c-4639-a89f-ef4308cf8c6f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:20.793290 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c91e6d7f-379c-4639-a89f-ef4308cf8c6f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:20.794519 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c91e6d7f-379c-4639-a89f-ef4308cf8c6f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:20.795058 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c91e6d7f-379c-4639-a89f-ef4308cf8c6f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:20.924879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c91e6d7f-379c-4639-a89f-ef4308cf8c6f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:20.932258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c91e6d7f-379c-4639-a89f-ef4308cf8c6f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1511 microversion: 2.1 time: 0.158779 May 10 19:58:20.932912 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 111/234] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:20 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:21.949623 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5481edb9-b803-49ae-8f42-f3f7a6e12bc0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:21.950323 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5481edb9-b803-49ae-8f42-f3f7a6e12bc0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:21.956442 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5481edb9-b803-49ae-8f42-f3f7a6e12bc0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:21.956894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5481edb9-b803-49ae-8f42-f3f7a6e12bc0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:21.957678 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5481edb9-b803-49ae-8f42-f3f7a6e12bc0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:21.958112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5481edb9-b803-49ae-8f42-f3f7a6e12bc0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:22.084455 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5481edb9-b803-49ae-8f42-f3f7a6e12bc0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:22.091715 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5481edb9-b803-49ae-8f42-f3f7a6e12bc0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1511 microversion: 2.1 time: 0.146254 May 10 19:58:22.092291 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 124/235] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:21 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:23.109252 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c38880c0-37f9-4c8e-b1d7-d3c24b7db068 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:23.109857 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c38880c0-37f9-4c8e-b1d7-d3c24b7db068 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:23.116637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c38880c0-37f9-4c8e-b1d7-d3c24b7db068 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:23.117086 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c38880c0-37f9-4c8e-b1d7-d3c24b7db068 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:23.117965 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c38880c0-37f9-4c8e-b1d7-d3c24b7db068 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:23.118405 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c38880c0-37f9-4c8e-b1d7-d3c24b7db068 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:23.273083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c38880c0-37f9-4c8e-b1d7-d3c24b7db068 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:23.281060 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c38880c0-37f9-4c8e-b1d7-d3c24b7db068 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1511 microversion: 2.1 time: 0.175663 May 10 19:58:23.281644 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 112/236] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:23 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:24.298708 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-61bc445e-723c-4408-99de-dd14c0899476 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:24.299324 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-61bc445e-723c-4408-99de-dd14c0899476 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:24.305815 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-61bc445e-723c-4408-99de-dd14c0899476 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:24.306328 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-61bc445e-723c-4408-99de-dd14c0899476 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:24.307060 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-61bc445e-723c-4408-99de-dd14c0899476 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:24.307551 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-61bc445e-723c-4408-99de-dd14c0899476 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:24.466929 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-61bc445e-723c-4408-99de-dd14c0899476 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:24.475291 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-61bc445e-723c-4408-99de-dd14c0899476 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1511 microversion: 2.1 time: 0.180477 May 10 19:58:24.476720 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 125/237] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:24 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:25.493141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9d237f44-45b8-4f8b-9467-5d8a0326e008 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:25.493758 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9d237f44-45b8-4f8b-9467-5d8a0326e008 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:25.506183 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9d237f44-45b8-4f8b-9467-5d8a0326e008 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:25.506183 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9d237f44-45b8-4f8b-9467-5d8a0326e008 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:25.506183 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9d237f44-45b8-4f8b-9467-5d8a0326e008 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:25.506183 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9d237f44-45b8-4f8b-9467-5d8a0326e008 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:25.636663 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9d237f44-45b8-4f8b-9467-5d8a0326e008 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:25.644516 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9d237f44-45b8-4f8b-9467-5d8a0326e008 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1511 microversion: 2.1 time: 0.154793 May 10 19:58:25.645080 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 113/238] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:25 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:26.661253 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1b9afed5-b5e4-45f0-90f5-eb4e98784a27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:26.661851 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1b9afed5-b5e4-45f0-90f5-eb4e98784a27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:26.667886 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b9afed5-b5e4-45f0-90f5-eb4e98784a27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:26.668334 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b9afed5-b5e4-45f0-90f5-eb4e98784a27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:26.669099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b9afed5-b5e4-45f0-90f5-eb4e98784a27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:26.669532 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b9afed5-b5e4-45f0-90f5-eb4e98784a27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:26.944835 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1b9afed5-b5e4-45f0-90f5-eb4e98784a27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:26.952069 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1b9afed5-b5e4-45f0-90f5-eb4e98784a27 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1517 microversion: 2.1 time: 0.294649 May 10 19:58:26.952678 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 126/239] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:26 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:30.359504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-937e178d-b4d6-4196-8564-49aba20b8cf0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Action: 'create', calling method: .version_select at 0x7fdd3a47f4c0>, body: {"keypair": {"name": "tempest-keypair-904504212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCJhzNHN8dsdW0478RMBsOSObzsXDpi1fuKsUZznY28C4cIcwdsxklf0AFyHw5kZnu94DcRJdBg794i1gPJBGAUE163iutU4Yqjd4PJdgCuiY9RcUD7kXxvf+S6wW0yEQ=="}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:30.380138 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-937e178d-b4d6-4196-8564-49aba20b8cf0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Getting quotas for project 866e5dd5364e4bd980ba03f1b76aac9d. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:58:30.383878 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-937e178d-b4d6-4196-8564-49aba20b8cf0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Getting quotas for user b642ac529ee043fd894a9188f30ed026 and project 866e5dd5364e4bd980ba03f1b76aac9d. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:58:30.420159 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-937e178d-b4d6-4196-8564-49aba20b8cf0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064152 May 10 19:58:30.421287 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 114/240] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 19:58:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:32.088903 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2071992271", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7e89c795-c88b-4f30-8394-9a44ee218158"}], "security_groups": [{"name": "tempest-securitygroup--1159683472"}], "key_name": "tempest-keypair-904504212", "user_data": "}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:32.189073 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] validate_networks() for [('7e89c795-c88b-4f30-8394-9a44ee218158', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 19:58:32.588614 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 19:58:32.589044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 19:58:32.589525 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 19:58:32.589949 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 19:58:32.590392 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 19:58:32.599113 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:32.599568 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:32.600381 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:32.600813 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:32.617635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Getting quotas for project 866e5dd5364e4bd980ba03f1b76aac9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:58:32.621553 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Getting quotas for user b642ac529ee043fd894a9188f30ed026 and project 866e5dd5364e4bd980ba03f1b76aac9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:58:32.633370 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 19:58:32.635672 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 19:58:32.680969 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-10ea627f-2039-4298-b738-bdb4f21f1467 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.596363 May 10 19:58:32.686329 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 127/241] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 19:58:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 19:58:32.692235 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-57814119-e90c-4852-bedd-aeda7df83477 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:32.693384 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-57814119-e90c-4852-bedd-aeda7df83477 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:32.756166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-57814119-e90c-4852-bedd-aeda7df83477 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:32.764159 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-57814119-e90c-4852-bedd-aeda7df83477 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1245 microversion: 2.1 time: 0.076380 May 10 19:58:32.765341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 115/242] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:32 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:33.632705 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-97dfd650-dd07-414b-8199-0d99a6b72cbb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:33.633292 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-97dfd650-dd07-414b-8199-0d99a6b72cbb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:33.639249 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-97dfd650-dd07-414b-8199-0d99a6b72cbb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:33.639696 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-97dfd650-dd07-414b-8199-0d99a6b72cbb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:33.640451 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-97dfd650-dd07-414b-8199-0d99a6b72cbb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:33.640889 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-97dfd650-dd07-414b-8199-0d99a6b72cbb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:33.662919 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-97dfd650-dd07-414b-8199-0d99a6b72cbb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/ips" status: 200 len: 145 microversion: 2.1 time: 0.035263 May 10 19:58:33.663471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 128/243] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 19:58:33 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:33.781139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a64316b4-3ead-4ed1-9bf3-be6a92972898 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:33.781669 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a64316b4-3ead-4ed1-9bf3-be6a92972898 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:33.788730 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a64316b4-3ead-4ed1-9bf3-be6a92972898 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:33.789209 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a64316b4-3ead-4ed1-9bf3-be6a92972898 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:33.789980 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a64316b4-3ead-4ed1-9bf3-be6a92972898 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:33.790422 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a64316b4-3ead-4ed1-9bf3-be6a92972898 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:33.849175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a64316b4-3ead-4ed1-9bf3-be6a92972898 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:33.856322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a64316b4-3ead-4ed1-9bf3-be6a92972898 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1249 microversion: 2.1 time: 0.079144 May 10 19:58:33.856890 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 116/244] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:33 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:34.481412 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b1acc327-9cab-4ddc-9dc7-929af39983bb tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:34.481909 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b1acc327-9cab-4ddc-9dc7-929af39983bb tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:34.487854 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1acc327-9cab-4ddc-9dc7-929af39983bb tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:34.488309 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1acc327-9cab-4ddc-9dc7-929af39983bb tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:34.489073 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1acc327-9cab-4ddc-9dc7-929af39983bb tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:34.489507 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1acc327-9cab-4ddc-9dc7-929af39983bb tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:34.511951 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b1acc327-9cab-4ddc-9dc7-929af39983bb tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/ips" status: 200 len: 151 microversion: 2.1 time: 0.034456 May 10 19:58:34.512540 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 129/245] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 19:58:34 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:34.875030 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7f550efa-fc79-4f9e-8eb0-a8055d0f53ad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:34.876539 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7f550efa-fc79-4f9e-8eb0-a8055d0f53ad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:34.887434 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7f550efa-fc79-4f9e-8eb0-a8055d0f53ad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:34.888135 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7f550efa-fc79-4f9e-8eb0-a8055d0f53ad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:34.889194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7f550efa-fc79-4f9e-8eb0-a8055d0f53ad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:34.889990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7f550efa-fc79-4f9e-8eb0-a8055d0f53ad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:34.979332 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7f550efa-fc79-4f9e-8eb0-a8055d0f53ad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:34.988578 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7f550efa-fc79-4f9e-8eb0-a8055d0f53ad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1303 microversion: 2.1 time: 0.119285 May 10 19:58:34.989165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 117/246] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:34 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:58:35.963023 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-686ac184-62c8-451c-a668-20efca5d1512 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c964e68d-b7cc-45fb-99c4-179339ced72d"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:35.964889 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-686ac184-62c8-451c-a668-20efca5d1512 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:35.971797 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-686ac184-62c8-451c-a668-20efca5d1512 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:35.972529 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-686ac184-62c8-451c-a668-20efca5d1512 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:35.973494 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-686ac184-62c8-451c-a668-20efca5d1512 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:35.974211 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-686ac184-62c8-451c-a668-20efca5d1512 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:36.005717 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-708ffaa5-bf61-4b2e-a570-09d0983e6006 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:36.006383 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-708ffaa5-bf61-4b2e-a570-09d0983e6006 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:36.018902 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-708ffaa5-bf61-4b2e-a570-09d0983e6006 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:36.020584 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-708ffaa5-bf61-4b2e-a570-09d0983e6006 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:36.024364 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-708ffaa5-bf61-4b2e-a570-09d0983e6006 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:36.025534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-708ffaa5-bf61-4b2e-a570-09d0983e6006 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:36.314742 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-708ffaa5-bf61-4b2e-a570-09d0983e6006 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:36.331552 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-708ffaa5-bf61-4b2e-a570-09d0983e6006 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1371 microversion: 2.1 time: 0.330306 May 10 19:58:36.341939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 118/247] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:35 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:58:36.349114 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-771e5591-e55a-4de1-9ddb-21680bf70a09 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a905d24f-2945-4de6-ad51-0917f656fec2"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:36.350296 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-771e5591-e55a-4de1-9ddb-21680bf70a09 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:36.357484 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-771e5591-e55a-4de1-9ddb-21680bf70a09 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:36.357937 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-771e5591-e55a-4de1-9ddb-21680bf70a09 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:36.359130 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-771e5591-e55a-4de1-9ddb-21680bf70a09 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:36.359575 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-771e5591-e55a-4de1-9ddb-21680bf70a09 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:38.662125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-686ac184-62c8-451c-a668-20efca5d1512 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.703276 May 10 19:58:38.664105 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 130/248] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 19:58:35 2022] POST /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/os-volume_attachments => generated 194 bytes in 2706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:38.673914 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-1c3335af-10b0-42ce-9de5-9d22988646f5 req-3b5a5256-7018-4b89-a546-b485c9fac886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f925619-022d-4541-a8ac-0c1cfd41efc0", "tag": "9da24b37-2570-4ec8-b96e-7dd6c39379fc"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:38.687938 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-1c3335af-10b0-42ce-9de5-9d22988646f5 req-3b5a5256-7018-4b89-a546-b485c9fac886 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:38.688768 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-1c3335af-10b0-42ce-9de5-9d22988646f5 req-3b5a5256-7018-4b89-a546-b485c9fac886 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:38.698683 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-771e5591-e55a-4de1-9ddb-21680bf70a09 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "POST /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.354862 May 10 19:58:38.699582 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 119/249] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 19:58:36 2022] POST /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/os-volume_attachments => generated 194 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:38.704684 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-1c3335af-10b0-42ce-9de5-9d22988646f5 req-3b5a5256-7018-4b89-a546-b485c9fac886 service nova] Creating event network-changed:9da24b37-2570-4ec8-b96e-7dd6c39379fc for instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 on hv-cinder-84131 May 10 19:58:38.707990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5356ee13-0c37-4e1f-9aad-f8a121c7b9ac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:38.708898 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5356ee13-0c37-4e1f-9aad-f8a121c7b9ac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:38.711059 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-1c3335af-10b0-42ce-9de5-9d22988646f5 req-3b5a5256-7018-4b89-a546-b485c9fac886 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045268 May 10 19:58:38.712024 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 131/250] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:38.717461 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5356ee13-0c37-4e1f-9aad-f8a121c7b9ac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:38.718277 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5356ee13-0c37-4e1f-9aad-f8a121c7b9ac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:38.719253 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5356ee13-0c37-4e1f-9aad-f8a121c7b9ac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:38.719986 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5356ee13-0c37-4e1f-9aad-f8a121c7b9ac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:38.925607 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5356ee13-0c37-4e1f-9aad-f8a121c7b9ac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:38.933008 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5356ee13-0c37-4e1f-9aad-f8a121c7b9ac tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1371 microversion: 2.1 time: 0.231807 May 10 19:58:38.933583 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 120/251] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:38 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:39.949537 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3769c9f0-85c5-4c06-a661-4de9231a6248 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:39.950237 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3769c9f0-85c5-4c06-a661-4de9231a6248 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:39.956711 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3769c9f0-85c5-4c06-a661-4de9231a6248 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:39.960709 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3769c9f0-85c5-4c06-a661-4de9231a6248 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:39.960709 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3769c9f0-85c5-4c06-a661-4de9231a6248 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:39.960709 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3769c9f0-85c5-4c06-a661-4de9231a6248 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:40.093929 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3769c9f0-85c5-4c06-a661-4de9231a6248 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:40.101875 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3769c9f0-85c5-4c06-a661-4de9231a6248 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1371 microversion: 2.1 time: 0.156525 May 10 19:58:40.102449 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 132/252] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:39 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:41.118851 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1b67d8c3-32ee-42ba-8fb6-4af4de168941 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:41.119604 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1b67d8c3-32ee-42ba-8fb6-4af4de168941 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:41.126382 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b67d8c3-32ee-42ba-8fb6-4af4de168941 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:41.127214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b67d8c3-32ee-42ba-8fb6-4af4de168941 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:41.128757 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b67d8c3-32ee-42ba-8fb6-4af4de168941 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:41.129445 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b67d8c3-32ee-42ba-8fb6-4af4de168941 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:41.260124 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1b67d8c3-32ee-42ba-8fb6-4af4de168941 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:41.267562 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1b67d8c3-32ee-42ba-8fb6-4af4de168941 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1371 microversion: 2.1 time: 0.152461 May 10 19:58:41.268220 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 121/253] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:41 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:42.284364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e9822960-a56f-4fa9-b9a5-28de7d47d3bf tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:42.285083 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e9822960-a56f-4fa9-b9a5-28de7d47d3bf tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:42.291421 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9822960-a56f-4fa9-b9a5-28de7d47d3bf tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:42.291875 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9822960-a56f-4fa9-b9a5-28de7d47d3bf tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:42.292643 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9822960-a56f-4fa9-b9a5-28de7d47d3bf tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:42.293082 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9822960-a56f-4fa9-b9a5-28de7d47d3bf tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:42.420123 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e9822960-a56f-4fa9-b9a5-28de7d47d3bf tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:42.428044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e9822960-a56f-4fa9-b9a5-28de7d47d3bf tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1371 microversion: 2.1 time: 0.147665 May 10 19:58:42.428616 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 133/254] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:42 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:43.444554 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7014d717-1f95-40fd-82a6-68a9a86038da tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:43.445168 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7014d717-1f95-40fd-82a6-68a9a86038da tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:43.451409 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7014d717-1f95-40fd-82a6-68a9a86038da tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:43.451860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7014d717-1f95-40fd-82a6-68a9a86038da tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:43.452625 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7014d717-1f95-40fd-82a6-68a9a86038da tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:43.453061 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7014d717-1f95-40fd-82a6-68a9a86038da tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:43.609618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7014d717-1f95-40fd-82a6-68a9a86038da tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:43.617014 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7014d717-1f95-40fd-82a6-68a9a86038da tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1371 microversion: 2.1 time: 0.176194 May 10 19:58:43.617798 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 122/255] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:43 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:43.653928 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-95f852bb-9831-4885-a32b-f297281965ad req-432f50cd-0206-4bed-a70d-a3510a2e8e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f925619-022d-4541-a8ac-0c1cfd41efc0", "name": "network-vif-plugged", "status": "completed", "tag": "9da24b37-2570-4ec8-b96e-7dd6c39379fc"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:43.666572 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-95f852bb-9831-4885-a32b-f297281965ad req-432f50cd-0206-4bed-a70d-a3510a2e8e96 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:43.667021 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-95f852bb-9831-4885-a32b-f297281965ad req-432f50cd-0206-4bed-a70d-a3510a2e8e96 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:43.681293 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-95f852bb-9831-4885-a32b-f297281965ad req-432f50cd-0206-4bed-a70d-a3510a2e8e96 service nova] Creating event network-vif-plugged:9da24b37-2570-4ec8-b96e-7dd6c39379fc for instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 on hv-cinder-84131 May 10 19:58:43.686333 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-95f852bb-9831-4885-a32b-f297281965ad req-432f50cd-0206-4bed-a70d-a3510a2e8e96 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036072 May 10 19:58:43.687045 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 134/256] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:44.636314 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c264b91d-8875-45e4-94d3-a94b360aede4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:44.636927 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c264b91d-8875-45e4-94d3-a94b360aede4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:44.644130 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c264b91d-8875-45e4-94d3-a94b360aede4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:44.644583 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c264b91d-8875-45e4-94d3-a94b360aede4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:44.645423 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c264b91d-8875-45e4-94d3-a94b360aede4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:44.645898 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c264b91d-8875-45e4-94d3-a94b360aede4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:44.776679 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c264b91d-8875-45e4-94d3-a94b360aede4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:44.784254 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c264b91d-8875-45e4-94d3-a94b360aede4 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1371 microversion: 2.1 time: 0.151705 May 10 19:58:44.784840 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 123/257] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:44 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:45.802584 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d7ad922f-a6c7-45dc-8796-317a60592429 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:45.803293 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d7ad922f-a6c7-45dc-8796-317a60592429 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:45.809381 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7ad922f-a6c7-45dc-8796-317a60592429 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:45.809835 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7ad922f-a6c7-45dc-8796-317a60592429 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:45.810641 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7ad922f-a6c7-45dc-8796-317a60592429 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:45.811089 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7ad922f-a6c7-45dc-8796-317a60592429 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:46.021213 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d7ad922f-a6c7-45dc-8796-317a60592429 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:46.028830 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d7ad922f-a6c7-45dc-8796-317a60592429 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1565 microversion: 2.1 time: 0.231416 May 10 19:58:46.029621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 135/258] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:45 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1565 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:46.045695 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-56a6e242-4486-4ef6-ae7b-4136ceb5de08 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:46.046251 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-56a6e242-4486-4ef6-ae7b-4136ceb5de08 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:46.053092 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-56a6e242-4486-4ef6-ae7b-4136ceb5de08 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:46.053551 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-56a6e242-4486-4ef6-ae7b-4136ceb5de08 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:46.054306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-56a6e242-4486-4ef6-ae7b-4136ceb5de08 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:46.054762 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-56a6e242-4486-4ef6-ae7b-4136ceb5de08 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:46.164038 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-56a6e242-4486-4ef6-ae7b-4136ceb5de08 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122133 May 10 19:58:46.164716 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 124/259] 10.222.0.57 () {58 vars in 1274 bytes} [Tue May 10 19:58:46 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:47.375678 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f692c2b2-b5e7-415c-836b-aaedd6740553 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: .version_select at 0x7fdd39408550>, body: {"keypair": {"name": "tempest-keypair-1940784930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlIkC9CPt6AOiln3Ck9aGyHTu0d3XDMKZRasj2rpKqi158H5ocaKZVnZBI8BCiOGqbsyUM1Samf5zt+eaDiBc7wMjbf8s+Siv5sCSf8bEDa+42gEzWXLv3CjAMP231Wgg=="}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:47.391700 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-f692c2b2-b5e7-415c-836b-aaedd6740553 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for project 477a9d7174e544efbbe7803ca7e77521. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:58:47.397540 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-f692c2b2-b5e7-415c-836b-aaedd6740553 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for user 2751fce03c284a91b152f545bd8c63ce and project 477a9d7174e544efbbe7803ca7e77521. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:58:47.422365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f692c2b2-b5e7-415c-836b-aaedd6740553 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050725 May 10 19:58:47.428743 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 136/260] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 19:58:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:47.658158 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-9775d75f-7eeb-4e40-a93f-9bc19a340bc1 req-9d1e6b3d-8fe9-4a93-bf95-b80cd675a562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f925619-022d-4541-a8ac-0c1cfd41efc0", "tag": "9da24b37-2570-4ec8-b96e-7dd6c39379fc"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:47.667015 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-9775d75f-7eeb-4e40-a93f-9bc19a340bc1 req-9d1e6b3d-8fe9-4a93-bf95-b80cd675a562 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:47.667789 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-9775d75f-7eeb-4e40-a93f-9bc19a340bc1 req-9d1e6b3d-8fe9-4a93-bf95-b80cd675a562 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:47.682349 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-9775d75f-7eeb-4e40-a93f-9bc19a340bc1 req-9d1e6b3d-8fe9-4a93-bf95-b80cd675a562 service nova] Creating event network-changed:9da24b37-2570-4ec8-b96e-7dd6c39379fc for instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 on hv-cinder-84131 May 10 19:58:47.687995 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-9775d75f-7eeb-4e40-a93f-9bc19a340bc1 req-9d1e6b3d-8fe9-4a93-bf95-b80cd675a562 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033875 May 10 19:58:47.692692 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 125/261] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:49.198393 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1863812970", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c69c6345-64af-49e8-8bf3-adcceaa64462"}], "security_groups": [{"name": "tempest-securitygroup--946374150"}], "key_name": "tempest-keypair-1940784930", "user_data": "}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:49.315403 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] validate_networks() for [('c69c6345-64af-49e8-8bf3-adcceaa64462', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 19:58:50.007443 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 19:58:50.007865 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 19:58:50.008334 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 19:58:50.008807 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 19:58:50.009214 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 19:58:50.018224 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:50.018708 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:50.019508 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:50.019941 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:50.037039 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for project 477a9d7174e544efbbe7803ca7e77521. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:58:50.041064 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for user 2751fce03c284a91b152f545bd8c63ce and project 477a9d7174e544efbbe7803ca7e77521. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:58:50.053011 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 19:58:50.055867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 19:58:50.113951 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-33d89ee8-3094-4fb0-9607-9f2ddf1eb5b3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.922897 May 10 19:58:50.119412 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 137/262] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 19:58:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 19:58:50.126735 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0f6d52c7-d267-4461-b009-8e126774a78b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:50.127567 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0f6d52c7-d267-4461-b009-8e126774a78b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:50.215591 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0f6d52c7-d267-4461-b009-8e126774a78b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:50.225341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0f6d52c7-d267-4461-b009-8e126774a78b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1242 microversion: 2.1 time: 0.104316 May 10 19:58:50.226119 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 126/263] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:50 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:58:51.251725 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-be9b67b4-42e4-484a-8850-7f63c054572a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:51.252388 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-be9b67b4-42e4-484a-8850-7f63c054572a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:51.272842 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be9b67b4-42e4-484a-8850-7f63c054572a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:51.273303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be9b67b4-42e4-484a-8850-7f63c054572a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:51.274112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be9b67b4-42e4-484a-8850-7f63c054572a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:51.274579 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be9b67b4-42e4-484a-8850-7f63c054572a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:51.723545 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-be9b67b4-42e4-484a-8850-7f63c054572a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:51.735118 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-be9b67b4-42e4-484a-8850-7f63c054572a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1302 microversion: 2.1 time: 0.494703 May 10 19:58:51.745433 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 138/264] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:51 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1302 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:52.754618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b4410ef2-cbe0-43f1-8a22-57a0c70e2da9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:52.755272 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b4410ef2-cbe0-43f1-8a22-57a0c70e2da9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:52.769218 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4410ef2-cbe0-43f1-8a22-57a0c70e2da9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:52.770065 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4410ef2-cbe0-43f1-8a22-57a0c70e2da9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:52.773626 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4410ef2-cbe0-43f1-8a22-57a0c70e2da9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:52.774953 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4410ef2-cbe0-43f1-8a22-57a0c70e2da9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:53.105899 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b4410ef2-cbe0-43f1-8a22-57a0c70e2da9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:53.137371 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b4410ef2-cbe0-43f1-8a22-57a0c70e2da9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1367 microversion: 2.1 time: 0.387767 May 10 19:58:53.151883 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 127/265] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:52 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:53.403693 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-2435caba-6147-4530-a596-e6adcc84fa84 req-d2d76d99-6c6a-49a3-96ff-dda23017dae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48eda565-f37d-4e78-a9e2-660d73a4de06", "tag": "2363e0cc-7730-434b-b019-c5496e668908"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:53.416816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-2435caba-6147-4530-a596-e6adcc84fa84 req-d2d76d99-6c6a-49a3-96ff-dda23017dae3 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:53.431852 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-2435caba-6147-4530-a596-e6adcc84fa84 req-d2d76d99-6c6a-49a3-96ff-dda23017dae3 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:53.455527 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-2435caba-6147-4530-a596-e6adcc84fa84 req-d2d76d99-6c6a-49a3-96ff-dda23017dae3 service nova] Creating event network-changed:2363e0cc-7730-434b-b019-c5496e668908 for instance 48eda565-f37d-4e78-a9e2-660d73a4de06 on hv-cinder-84131 May 10 19:58:53.468298 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-2435caba-6147-4530-a596-e6adcc84fa84 req-d2d76d99-6c6a-49a3-96ff-dda23017dae3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068365 May 10 19:58:53.469160 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 139/266] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:53.826864 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-06c666a9-56be-4baa-a0d6-ef56b7d06d4d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:53.834110 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-06c666a9-56be-4baa-a0d6-ef56b7d06d4d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:53.834803 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-06c666a9-56be-4baa-a0d6-ef56b7d06d4d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:53.897236 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-06c666a9-56be-4baa-a0d6-ef56b7d06d4d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Going to try to stop instance {{(pid=117124) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 19:58:53.957235 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-06c666a9-56be-4baa-a0d6-ef56b7d06d4d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "POST /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/action" status: 202 len: 0 microversion: 2.1 time: 0.134065 May 10 19:58:53.968489 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-74e12371-1bce-428b-9853-56af6d97d046 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:53.969205 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-74e12371-1bce-428b-9853-56af6d97d046 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:53.974419 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 128/267] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 19:58:53 2022] POST /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 19:58:53.976297 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-74e12371-1bce-428b-9853-56af6d97d046 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:53.976946 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-74e12371-1bce-428b-9853-56af6d97d046 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:53.977828 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-74e12371-1bce-428b-9853-56af6d97d046 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:53.978536 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-74e12371-1bce-428b-9853-56af6d97d046 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:54.163694 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d9ab39d6-f22d-42c5-b1fa-5abd370e74bd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:54.164871 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d9ab39d6-f22d-42c5-b1fa-5abd370e74bd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:54.173142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d9ab39d6-f22d-42c5-b1fa-5abd370e74bd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:54.173966 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d9ab39d6-f22d-42c5-b1fa-5abd370e74bd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:54.175845 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d9ab39d6-f22d-42c5-b1fa-5abd370e74bd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:54.176669 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d9ab39d6-f22d-42c5-b1fa-5abd370e74bd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:54.264628 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-74e12371-1bce-428b-9853-56af6d97d046 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:54.272566 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-74e12371-1bce-428b-9853-56af6d97d046 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1723 microversion: 2.1 time: 0.308535 May 10 19:58:54.273085 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 140/268] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:53 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:58:54.346499 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d9ab39d6-f22d-42c5-b1fa-5abd370e74bd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:54.355167 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d9ab39d6-f22d-42c5-b1fa-5abd370e74bd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1367 microversion: 2.1 time: 0.200390 May 10 19:58:54.356133 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 129/269] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:54 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:55.290679 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-260bb200-28be-4fab-ac32-907949fcef56 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:55.291868 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-260bb200-28be-4fab-ac32-907949fcef56 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:55.300605 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-260bb200-28be-4fab-ac32-907949fcef56 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:55.313967 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-260bb200-28be-4fab-ac32-907949fcef56 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:55.315284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-260bb200-28be-4fab-ac32-907949fcef56 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:55.316400 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-260bb200-28be-4fab-ac32-907949fcef56 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:55.379047 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f06ef248-d713-45fe-b038-5e3dc1c337a3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:55.383657 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f06ef248-d713-45fe-b038-5e3dc1c337a3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:55.402433 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f06ef248-d713-45fe-b038-5e3dc1c337a3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:55.404673 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f06ef248-d713-45fe-b038-5e3dc1c337a3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:55.425475 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f06ef248-d713-45fe-b038-5e3dc1c337a3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:55.425946 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f06ef248-d713-45fe-b038-5e3dc1c337a3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:55.606054 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-260bb200-28be-4fab-ac32-907949fcef56 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:55.616954 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-260bb200-28be-4fab-ac32-907949fcef56 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1723 microversion: 2.1 time: 0.330426 May 10 19:58:55.618190 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 141/270] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:55 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:58:56.197769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f06ef248-d713-45fe-b038-5e3dc1c337a3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:56.209720 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f06ef248-d713-45fe-b038-5e3dc1c337a3 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1367 microversion: 2.1 time: 0.839297 May 10 19:58:56.210647 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 130/271] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:55 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1367 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:58:56.640801 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-597cf7a1-a05d-4f99-a85f-1f7dcf05a5ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:56.641425 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-597cf7a1-a05d-4f99-a85f-1f7dcf05a5ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:56.648436 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-597cf7a1-a05d-4f99-a85f-1f7dcf05a5ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:56.648935 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-597cf7a1-a05d-4f99-a85f-1f7dcf05a5ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:56.649782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-597cf7a1-a05d-4f99-a85f-1f7dcf05a5ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:56.650217 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-597cf7a1-a05d-4f99-a85f-1f7dcf05a5ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:56.802338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-597cf7a1-a05d-4f99-a85f-1f7dcf05a5ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:56.812937 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-597cf7a1-a05d-4f99-a85f-1f7dcf05a5ab tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1723 microversion: 2.1 time: 0.181069 May 10 19:58:56.813561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 142/272] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:56 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:57.232326 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3b435d06-3e37-4c54-a9c7-0eef5603d1fe tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:57.235220 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3b435d06-3e37-4c54-a9c7-0eef5603d1fe tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:57.254110 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b435d06-3e37-4c54-a9c7-0eef5603d1fe tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:57.254626 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b435d06-3e37-4c54-a9c7-0eef5603d1fe tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:57.255424 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b435d06-3e37-4c54-a9c7-0eef5603d1fe tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:57.258694 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b435d06-3e37-4c54-a9c7-0eef5603d1fe tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:57.497682 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3b435d06-3e37-4c54-a9c7-0eef5603d1fe tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:57.507136 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3b435d06-3e37-4c54-a9c7-0eef5603d1fe tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1367 microversion: 2.1 time: 0.279036 May 10 19:58:57.507652 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 131/273] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:57 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:57.712444 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-32b0463e-1c3d-4d89-a8aa-9f7cb68d93b6 req-9ed22bbf-1e28-4d9f-b6a4-6837168691fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48eda565-f37d-4e78-a9e2-660d73a4de06", "name": "network-vif-plugged", "status": "completed", "tag": "2363e0cc-7730-434b-b019-c5496e668908"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:57.725794 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-32b0463e-1c3d-4d89-a8aa-9f7cb68d93b6 req-9ed22bbf-1e28-4d9f-b6a4-6837168691fb service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:57.726249 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-32b0463e-1c3d-4d89-a8aa-9f7cb68d93b6 req-9ed22bbf-1e28-4d9f-b6a4-6837168691fb service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:57.737961 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-32b0463e-1c3d-4d89-a8aa-9f7cb68d93b6 req-9ed22bbf-1e28-4d9f-b6a4-6837168691fb service nova] Creating event network-vif-plugged:2363e0cc-7730-434b-b019-c5496e668908 for instance 48eda565-f37d-4e78-a9e2-660d73a4de06 on hv-cinder-84131 May 10 19:58:57.748927 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-32b0463e-1c3d-4d89-a8aa-9f7cb68d93b6 req-9ed22bbf-1e28-4d9f-b6a4-6837168691fb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040854 May 10 19:58:57.749437 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 143/274] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:57.831848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0abeb182-709a-41bf-a85f-92ace1a50ecb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:57.832473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0abeb182-709a-41bf-a85f-92ace1a50ecb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:57.843653 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0abeb182-709a-41bf-a85f-92ace1a50ecb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:57.844115 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0abeb182-709a-41bf-a85f-92ace1a50ecb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:57.844913 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0abeb182-709a-41bf-a85f-92ace1a50ecb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:57.845383 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0abeb182-709a-41bf-a85f-92ace1a50ecb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:58.078138 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0abeb182-709a-41bf-a85f-92ace1a50ecb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:58.087044 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0abeb182-709a-41bf-a85f-92ace1a50ecb tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1723 microversion: 2.1 time: 0.259645 May 10 19:58:58.088158 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 132/275] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:57 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:58.315374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1535467e-7677-4287-bce4-18e5a37f7c05 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Action: 'create', calling method: .version_select at 0x7fdd3942cc10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-209518868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9chEdWgVaQW8CpSXWGLn4W6ZmMsWzT1aLTLLyQOW5uDXMzfO0a3ruvlKgipm5wqwT4uvXtysF7x+9m8TJjk6t5ZgUeYw0caCpEyPde2N6nwxrkJ1wIIYP5LU2o/afeLQ=="}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:58:58.329398 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-1535467e-7677-4287-bce4-18e5a37f7c05 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Getting quotas for project 493768250fbb449a8b5430992e76b60f. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:58:58.333348 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-1535467e-7677-4287-bce4-18e5a37f7c05 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Getting quotas for user be0ebfb74d254359b4dfa36d9aff4ac6 and project 493768250fbb449a8b5430992e76b60f. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:58:58.355874 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1535467e-7677-4287-bce4-18e5a37f7c05 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.245189 May 10 19:58:58.356484 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 144/276] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 19:58:58 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:58:58.523708 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3e5aa113-44fd-4214-8aa9-436bb9da41d7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:58.525115 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3e5aa113-44fd-4214-8aa9-436bb9da41d7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:58.532775 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3e5aa113-44fd-4214-8aa9-436bb9da41d7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:58.533740 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3e5aa113-44fd-4214-8aa9-436bb9da41d7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:58.534539 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3e5aa113-44fd-4214-8aa9-436bb9da41d7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:58.535010 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3e5aa113-44fd-4214-8aa9-436bb9da41d7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:58.675974 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3e5aa113-44fd-4214-8aa9-436bb9da41d7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:58.684027 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3e5aa113-44fd-4214-8aa9-436bb9da41d7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1367 microversion: 2.1 time: 0.164240 May 10 19:58:58.684616 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 133/277] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:58 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:59.110729 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6fc4ed78-51b7-4952-9edc-79d531599216 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:59.113948 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6fc4ed78-51b7-4952-9edc-79d531599216 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:59.121179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6fc4ed78-51b7-4952-9edc-79d531599216 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:59.122107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6fc4ed78-51b7-4952-9edc-79d531599216 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:59.123150 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6fc4ed78-51b7-4952-9edc-79d531599216 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:59.123884 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6fc4ed78-51b7-4952-9edc-79d531599216 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:59.287761 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6fc4ed78-51b7-4952-9edc-79d531599216 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:59.295884 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6fc4ed78-51b7-4952-9edc-79d531599216 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1723 microversion: 2.1 time: 0.195906 May 10 19:58:59.296634 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 145/278] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:59 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:58:59.701807 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-09df52b7-c1ea-42b7-a9f3-f2cf20013d64 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:58:59.703293 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-09df52b7-c1ea-42b7-a9f3-f2cf20013d64 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:58:59.711094 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09df52b7-c1ea-42b7-a9f3-f2cf20013d64 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:59.711839 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09df52b7-c1ea-42b7-a9f3-f2cf20013d64 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:59.713208 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09df52b7-c1ea-42b7-a9f3-f2cf20013d64 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:58:59.713883 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09df52b7-c1ea-42b7-a9f3-f2cf20013d64 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:58:59.870433 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-09df52b7-c1ea-42b7-a9f3-f2cf20013d64 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:58:59.878707 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-09df52b7-c1ea-42b7-a9f3-f2cf20013d64 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1367 microversion: 2.1 time: 0.180882 May 10 19:58:59.879288 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 134/279] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:58:59 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:00.313293 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bb2c6701-96a8-4bb7-ac52-c5350dfbfabf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:00.316672 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bb2c6701-96a8-4bb7-ac52-c5350dfbfabf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:00.323727 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb2c6701-96a8-4bb7-ac52-c5350dfbfabf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:00.324180 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb2c6701-96a8-4bb7-ac52-c5350dfbfabf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:00.325136 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb2c6701-96a8-4bb7-ac52-c5350dfbfabf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:00.325566 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb2c6701-96a8-4bb7-ac52-c5350dfbfabf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:00.475932 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bb2c6701-96a8-4bb7-ac52-c5350dfbfabf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:00.484172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bb2c6701-96a8-4bb7-ac52-c5350dfbfabf tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1723 microversion: 2.1 time: 0.174759 May 10 19:59:00.484782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 146/280] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:00 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:00.896382 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1edf41f5-7104-47e8-a050-0d60fd33a08a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:00.896996 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1edf41f5-7104-47e8-a050-0d60fd33a08a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:00.903937 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1edf41f5-7104-47e8-a050-0d60fd33a08a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:00.904389 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1edf41f5-7104-47e8-a050-0d60fd33a08a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:00.905164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1edf41f5-7104-47e8-a050-0d60fd33a08a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:00.906301 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1edf41f5-7104-47e8-a050-0d60fd33a08a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:01.096490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1edf41f5-7104-47e8-a050-0d60fd33a08a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:01.106203 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1edf41f5-7104-47e8-a050-0d60fd33a08a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1557 microversion: 2.1 time: 0.213386 May 10 19:59:01.108426 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 135/281] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:00 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:01.125362 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-830e3a55-1429-4153-9172-0d0c1ea8fcda tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:01.125813 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-830e3a55-1429-4153-9172-0d0c1ea8fcda tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:01.133221 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-830e3a55-1429-4153-9172-0d0c1ea8fcda tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:01.133743 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-830e3a55-1429-4153-9172-0d0c1ea8fcda tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:01.134885 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-830e3a55-1429-4153-9172-0d0c1ea8fcda tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:01.135313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-830e3a55-1429-4153-9172-0d0c1ea8fcda tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:01.225328 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-830e3a55-1429-4153-9172-0d0c1ea8fcda tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104145 May 10 19:59:01.225934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 147/282] 10.222.0.57 () {58 vars in 1274 bytes} [Tue May 10 19:59:01 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:59:01.501768 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a48b26fb-8d8c-4c2a-b649-308d7aaf22e6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:01.502385 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a48b26fb-8d8c-4c2a-b649-308d7aaf22e6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:01.508410 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a48b26fb-8d8c-4c2a-b649-308d7aaf22e6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:01.508863 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a48b26fb-8d8c-4c2a-b649-308d7aaf22e6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:01.509668 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a48b26fb-8d8c-4c2a-b649-308d7aaf22e6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:01.510105 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a48b26fb-8d8c-4c2a-b649-308d7aaf22e6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:01.646166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a48b26fb-8d8c-4c2a-b649-308d7aaf22e6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:01.654132 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a48b26fb-8d8c-4c2a-b649-308d7aaf22e6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1723 microversion: 2.1 time: 0.156263 May 10 19:59:01.654757 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 136/283] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:01 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:02.459763 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-66cee23d-1e5d-4029-97c7-236b8c7569ad req-6a901ee4-a053-4152-8424-17e41800fac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48eda565-f37d-4e78-a9e2-660d73a4de06", "tag": "2363e0cc-7730-434b-b019-c5496e668908"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:02.468338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-66cee23d-1e5d-4029-97c7-236b8c7569ad req-6a901ee4-a053-4152-8424-17e41800fac8 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:02.468788 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-66cee23d-1e5d-4029-97c7-236b8c7569ad req-6a901ee4-a053-4152-8424-17e41800fac8 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:02.481311 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-66cee23d-1e5d-4029-97c7-236b8c7569ad req-6a901ee4-a053-4152-8424-17e41800fac8 service nova] Creating event network-changed:2363e0cc-7730-434b-b019-c5496e668908 for instance 48eda565-f37d-4e78-a9e2-660d73a4de06 on hv-cinder-84131 May 10 19:59:02.487788 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-66cee23d-1e5d-4029-97c7-236b8c7569ad req-6a901ee4-a053-4152-8424-17e41800fac8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032080 May 10 19:59:02.489004 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 148/284] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:59:02.671636 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-938b812e-563c-4e84-942a-de9bafd8fcd7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:02.672912 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-938b812e-563c-4e84-942a-de9bafd8fcd7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:02.679516 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-938b812e-563c-4e84-942a-de9bafd8fcd7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:02.680001 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-938b812e-563c-4e84-942a-de9bafd8fcd7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:02.680833 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-938b812e-563c-4e84-942a-de9bafd8fcd7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:02.681493 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-938b812e-563c-4e84-942a-de9bafd8fcd7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:02.860555 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-938b812e-563c-4e84-942a-de9bafd8fcd7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:02.873240 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-938b812e-563c-4e84-942a-de9bafd8fcd7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1723 microversion: 2.1 time: 0.205549 May 10 19:59:02.874508 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 137/285] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:02 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:03.891672 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-350b564b-51c5-41e8-bb25-44b7754ebfd9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:03.892282 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-350b564b-51c5-41e8-bb25-44b7754ebfd9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:03.898822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-350b564b-51c5-41e8-bb25-44b7754ebfd9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:03.899272 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-350b564b-51c5-41e8-bb25-44b7754ebfd9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:03.900028 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-350b564b-51c5-41e8-bb25-44b7754ebfd9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:03.900509 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-350b564b-51c5-41e8-bb25-44b7754ebfd9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:04.030104 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-350b564b-51c5-41e8-bb25-44b7754ebfd9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:04.038371 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-350b564b-51c5-41e8-bb25-44b7754ebfd9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1723 microversion: 2.1 time: 0.150940 May 10 19:59:04.038976 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 149/286] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:03 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:05.055884 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b0a037bf-19d4-4871-b180-9383ff2c1cba tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:05.056567 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b0a037bf-19d4-4871-b180-9383ff2c1cba tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:05.063246 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0a037bf-19d4-4871-b180-9383ff2c1cba tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:05.063706 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0a037bf-19d4-4871-b180-9383ff2c1cba tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:05.064507 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0a037bf-19d4-4871-b180-9383ff2c1cba tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:05.064952 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0a037bf-19d4-4871-b180-9383ff2c1cba tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:05.194544 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b0a037bf-19d4-4871-b180-9383ff2c1cba tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:05.202221 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b0a037bf-19d4-4871-b180-9383ff2c1cba tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1723 microversion: 2.1 time: 0.150175 May 10 19:59:05.202833 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 138/287] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:05 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:06.220650 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c460305d-c105-400c-ade2-288ad4b57cea tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:06.221414 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c460305d-c105-400c-ade2-288ad4b57cea tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:06.227697 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c460305d-c105-400c-ade2-288ad4b57cea tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:06.228154 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c460305d-c105-400c-ade2-288ad4b57cea tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:06.228939 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c460305d-c105-400c-ade2-288ad4b57cea tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:06.229381 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c460305d-c105-400c-ade2-288ad4b57cea tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:06.359353 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c460305d-c105-400c-ade2-288ad4b57cea tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:06.368002 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c460305d-c105-400c-ade2-288ad4b57cea tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1700 microversion: 2.1 time: 0.151680 May 10 19:59:06.368782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 150/288] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:06 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1700 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:06.384662 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-907ea632-d793-40f7-bb88-59d69c554bf6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:06.391034 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-907ea632-d793-40f7-bb88-59d69c554bf6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:06.391493 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-907ea632-d793-40f7-bb88-59d69c554bf6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:06.414640 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-907ea632-d793-40f7-bb88-59d69c554bf6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Going to try to start instance {{(pid=117124) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 19:59:06.456812 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-907ea632-d793-40f7-bb88-59d69c554bf6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "POST /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/action" status: 202 len: 0 microversion: 2.1 time: 0.075800 May 10 19:59:06.460406 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 139/289] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 19:59:06 2022] POST /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 19:59:06.465516 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7e50ef7a-e11c-4c95-9808-59f73ddf781c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:06.466125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7e50ef7a-e11c-4c95-9808-59f73ddf781c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:06.472848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e50ef7a-e11c-4c95-9808-59f73ddf781c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:06.473463 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e50ef7a-e11c-4c95-9808-59f73ddf781c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:06.474263 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e50ef7a-e11c-4c95-9808-59f73ddf781c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:06.474848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e50ef7a-e11c-4c95-9808-59f73ddf781c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:06.614061 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7e50ef7a-e11c-4c95-9808-59f73ddf781c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:06.622358 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7e50ef7a-e11c-4c95-9808-59f73ddf781c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1709 microversion: 2.1 time: 0.160472 May 10 19:59:06.622960 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 151/290] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:06 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:07.640033 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-887e2406-04bc-4a4f-9c7b-473bc77ba3f0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:07.640736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-887e2406-04bc-4a4f-9c7b-473bc77ba3f0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:07.647762 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-887e2406-04bc-4a4f-9c7b-473bc77ba3f0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:07.648213 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-887e2406-04bc-4a4f-9c7b-473bc77ba3f0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:07.648991 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-887e2406-04bc-4a4f-9c7b-473bc77ba3f0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:07.649428 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-887e2406-04bc-4a4f-9c7b-473bc77ba3f0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:07.781813 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-887e2406-04bc-4a4f-9c7b-473bc77ba3f0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:07.791361 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-887e2406-04bc-4a4f-9c7b-473bc77ba3f0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1709 microversion: 2.1 time: 0.155966 May 10 19:59:07.791996 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 140/291] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:07 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:08.810381 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0c0b0d3a-0828-446d-853f-482e72cdcda8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:08.810915 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0c0b0d3a-0828-446d-853f-482e72cdcda8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:08.817141 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0c0b0d3a-0828-446d-853f-482e72cdcda8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:08.817588 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0c0b0d3a-0828-446d-853f-482e72cdcda8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:08.818339 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0c0b0d3a-0828-446d-853f-482e72cdcda8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:08.818801 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0c0b0d3a-0828-446d-853f-482e72cdcda8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:08.952138 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0c0b0d3a-0828-446d-853f-482e72cdcda8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:08.960341 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0c0b0d3a-0828-446d-853f-482e72cdcda8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1713 microversion: 2.1 time: 0.153879 May 10 19:59:08.961016 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 152/292] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:08 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1713 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:15.633171 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-911581194", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-209518868", "security_groups": [{"name": "tempest-secgroup-smoke-470214062"}], "block_device_mapping_v2": [{"uuid": "cc764e4d-fbfb-4356-9075-785567f1bc91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d20c2327-06bd-4a9c-bc81-ab7a5e947390"}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:15.755173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] validate_networks() for [('d20c2327-06bd-4a9c-bc81-ab7a5e947390', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 19:59:16.107615 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 19:59:16.108013 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 19:59:16.108488 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 19:59:16.108902 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 19:59:16.109314 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 19:59:16.118306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:16.118792 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:16.119598 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:16.120038 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:16.136980 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Getting quotas for project 493768250fbb449a8b5430992e76b60f. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 19:59:16.140840 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Getting quotas for user be0ebfb74d254359b4dfa36d9aff4ac6 and project 493768250fbb449a8b5430992e76b60f. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 19:59:16.195695 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 19:59:16.197815 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc764e4d-fbfb-4356-9075-785567f1bc91',volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 19:59:16.319664 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b5dd051c-a543-4693-8373-df234e738eb0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.690341 May 10 19:59:16.320321 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 141/293] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 19:59:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 19:59:16.330173 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ee030fff-f1ac-49e3-837b-f058015ce767 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:16.330873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ee030fff-f1ac-49e3-837b-f058015ce767 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:16.382363 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ee030fff-f1ac-49e3-837b-f058015ce767 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:16.388798 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ee030fff-f1ac-49e3-837b-f058015ce767 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1093 microversion: 2.1 time: 0.062476 May 10 19:59:16.389483 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 153/294] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:16 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:17.406096 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-99cc60f0-baaf-4c6c-8e93-32b242c6964d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:17.407059 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-99cc60f0-baaf-4c6c-8e93-32b242c6964d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:17.413176 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99cc60f0-baaf-4c6c-8e93-32b242c6964d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:17.413636 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99cc60f0-baaf-4c6c-8e93-32b242c6964d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:17.414656 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99cc60f0-baaf-4c6c-8e93-32b242c6964d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:17.415099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99cc60f0-baaf-4c6c-8e93-32b242c6964d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:17.488166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-99cc60f0-baaf-4c6c-8e93-32b242c6964d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:17.496954 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-99cc60f0-baaf-4c6c-8e93-32b242c6964d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1199 microversion: 2.1 time: 0.094755 May 10 19:59:17.497935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 142/295] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:17 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:18.514958 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d1b32769-961d-471a-80f0-163bd100d11f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:18.515609 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d1b32769-961d-471a-80f0-163bd100d11f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:18.522917 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1b32769-961d-471a-80f0-163bd100d11f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:18.523645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1b32769-961d-471a-80f0-163bd100d11f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:18.524609 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1b32769-961d-471a-80f0-163bd100d11f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:18.525213 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1b32769-961d-471a-80f0-163bd100d11f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:18.665968 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d1b32769-961d-471a-80f0-163bd100d11f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:18.673284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d1b32769-961d-471a-80f0-163bd100d11f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.162228 May 10 19:59:18.673866 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 154/296] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:18 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:19.014938 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-5c537549-492b-46a2-89a8-3380a6586521 req-018db75b-4511-4415-a3d4-c38280893682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e0633f-fa61-4d94-8b8b-663d1a59ed6f", "tag": "d82adb7e-2a47-4a94-aa72-c7ea1f21f48c"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:19.051730 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-5c537549-492b-46a2-89a8-3380a6586521 req-018db75b-4511-4415-a3d4-c38280893682 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:19.052498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-5c537549-492b-46a2-89a8-3380a6586521 req-018db75b-4511-4415-a3d4-c38280893682 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:19.077061 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-5c537549-492b-46a2-89a8-3380a6586521 req-018db75b-4511-4415-a3d4-c38280893682 service nova] Creating event network-changed:d82adb7e-2a47-4a94-aa72-c7ea1f21f48c for instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f on hv-cinder-84131 May 10 19:59:19.086393 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-5c537549-492b-46a2-89a8-3380a6586521 req-018db75b-4511-4415-a3d4-c38280893682 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092225 May 10 19:59:19.087411 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 143/297] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:59:19.691278 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-706e0618-3d05-410f-bd29-db9d10ce08c0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:19.691859 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-706e0618-3d05-410f-bd29-db9d10ce08c0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:19.698168 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-706e0618-3d05-410f-bd29-db9d10ce08c0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:19.698668 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-706e0618-3d05-410f-bd29-db9d10ce08c0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:19.699442 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-706e0618-3d05-410f-bd29-db9d10ce08c0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:19.699912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-706e0618-3d05-410f-bd29-db9d10ce08c0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:19.832809 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-706e0618-3d05-410f-bd29-db9d10ce08c0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:19.841857 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-706e0618-3d05-410f-bd29-db9d10ce08c0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.155105 May 10 19:59:19.842447 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 155/298] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:19 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:20.859471 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-978515f1-96cc-40e0-9513-c552982c421e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:20.860102 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-978515f1-96cc-40e0-9513-c552982c421e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:20.867145 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-978515f1-96cc-40e0-9513-c552982c421e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:20.867598 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-978515f1-96cc-40e0-9513-c552982c421e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:20.868362 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-978515f1-96cc-40e0-9513-c552982c421e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:20.868798 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-978515f1-96cc-40e0-9513-c552982c421e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:20.999729 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-978515f1-96cc-40e0-9513-c552982c421e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:21.006980 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-978515f1-96cc-40e0-9513-c552982c421e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.152034 May 10 19:59:21.007552 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 144/299] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:20 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:22.024007 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b8c63370-b7b8-417d-a491-fb9db01dbb5c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:22.024627 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b8c63370-b7b8-417d-a491-fb9db01dbb5c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:22.031668 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8c63370-b7b8-417d-a491-fb9db01dbb5c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:22.032130 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8c63370-b7b8-417d-a491-fb9db01dbb5c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:22.032912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8c63370-b7b8-417d-a491-fb9db01dbb5c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:22.036547 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8c63370-b7b8-417d-a491-fb9db01dbb5c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:22.164816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b8c63370-b7b8-417d-a491-fb9db01dbb5c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:22.171993 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b8c63370-b7b8-417d-a491-fb9db01dbb5c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.151837 May 10 19:59:22.172563 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 156/300] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:22 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:23.189088 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-eeba6cb3-a007-4897-86e0-3e7b828be869 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:23.189704 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-eeba6cb3-a007-4897-86e0-3e7b828be869 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:23.196040 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eeba6cb3-a007-4897-86e0-3e7b828be869 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:23.196492 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eeba6cb3-a007-4897-86e0-3e7b828be869 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:23.197255 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eeba6cb3-a007-4897-86e0-3e7b828be869 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:23.197689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eeba6cb3-a007-4897-86e0-3e7b828be869 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:23.326021 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-eeba6cb3-a007-4897-86e0-3e7b828be869 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:23.333760 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-eeba6cb3-a007-4897-86e0-3e7b828be869 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.148494 May 10 19:59:23.334333 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 145/301] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:23 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:24.351276 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8ba6fe04-fea3-4384-aed1-c25aab37dd3c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:24.351915 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8ba6fe04-fea3-4384-aed1-c25aab37dd3c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:24.358560 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8ba6fe04-fea3-4384-aed1-c25aab37dd3c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:24.359017 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8ba6fe04-fea3-4384-aed1-c25aab37dd3c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:24.359783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8ba6fe04-fea3-4384-aed1-c25aab37dd3c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:24.360218 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8ba6fe04-fea3-4384-aed1-c25aab37dd3c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:24.487562 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8ba6fe04-fea3-4384-aed1-c25aab37dd3c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:24.494713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8ba6fe04-fea3-4384-aed1-c25aab37dd3c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.147387 May 10 19:59:24.495280 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 157/302] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:24 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:25.511393 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b781d6e3-fe0a-4db5-890a-9e853be866f2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:25.512005 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b781d6e3-fe0a-4db5-890a-9e853be866f2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:25.517922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b781d6e3-fe0a-4db5-890a-9e853be866f2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:25.518381 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b781d6e3-fe0a-4db5-890a-9e853be866f2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:25.519220 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b781d6e3-fe0a-4db5-890a-9e853be866f2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:25.519661 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b781d6e3-fe0a-4db5-890a-9e853be866f2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:25.647677 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b781d6e3-fe0a-4db5-890a-9e853be866f2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:25.655044 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b781d6e3-fe0a-4db5-890a-9e853be866f2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.147456 May 10 19:59:25.655614 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 146/303] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:25 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:26.672013 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7f5fb886-362f-4303-aeba-c9f6c90e1274 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:26.672621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7f5fb886-362f-4303-aeba-c9f6c90e1274 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:26.679020 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7f5fb886-362f-4303-aeba-c9f6c90e1274 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:26.679473 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7f5fb886-362f-4303-aeba-c9f6c90e1274 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:26.680235 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7f5fb886-362f-4303-aeba-c9f6c90e1274 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:26.680670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7f5fb886-362f-4303-aeba-c9f6c90e1274 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:26.806811 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7f5fb886-362f-4303-aeba-c9f6c90e1274 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:26.814016 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7f5fb886-362f-4303-aeba-c9f6c90e1274 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.145829 May 10 19:59:26.814621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 158/304] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:26 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:27.830621 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-59e443a1-c2ff-4e13-9472-f813100682ca tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:27.831237 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-59e443a1-c2ff-4e13-9472-f813100682ca tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:27.837479 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-59e443a1-c2ff-4e13-9472-f813100682ca tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:27.837934 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-59e443a1-c2ff-4e13-9472-f813100682ca tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:27.838738 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-59e443a1-c2ff-4e13-9472-f813100682ca tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:27.839179 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-59e443a1-c2ff-4e13-9472-f813100682ca tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:27.969531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-59e443a1-c2ff-4e13-9472-f813100682ca tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:27.977276 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-59e443a1-c2ff-4e13-9472-f813100682ca tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.150544 May 10 19:59:27.977845 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 147/305] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:27 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:28.993307 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-37294415-4f8c-45a8-9293-ffbcd939bf70 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:28.993952 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-37294415-4f8c-45a8-9293-ffbcd939bf70 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:29.000461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37294415-4f8c-45a8-9293-ffbcd939bf70 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:29.000909 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37294415-4f8c-45a8-9293-ffbcd939bf70 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:29.001668 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37294415-4f8c-45a8-9293-ffbcd939bf70 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:29.002799 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37294415-4f8c-45a8-9293-ffbcd939bf70 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:29.129348 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-37294415-4f8c-45a8-9293-ffbcd939bf70 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:29.138161 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-37294415-4f8c-45a8-9293-ffbcd939bf70 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.148802 May 10 19:59:29.139027 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 159/306] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:28 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:29.754631 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-22c9beb4-8230-4fc0-8533-2258b2cfe957 req-944de96c-9f3a-4c6c-b9fc-5ad10b894a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e0633f-fa61-4d94-8b8b-663d1a59ed6f", "name": "network-vif-plugged", "status": "completed", "tag": "d82adb7e-2a47-4a94-aa72-c7ea1f21f48c"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:29.766873 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-22c9beb4-8230-4fc0-8533-2258b2cfe957 req-944de96c-9f3a-4c6c-b9fc-5ad10b894a8a service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:29.767838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-22c9beb4-8230-4fc0-8533-2258b2cfe957 req-944de96c-9f3a-4c6c-b9fc-5ad10b894a8a service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:29.778437 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-22c9beb4-8230-4fc0-8533-2258b2cfe957 req-944de96c-9f3a-4c6c-b9fc-5ad10b894a8a service nova] Creating event network-vif-plugged:d82adb7e-2a47-4a94-aa72-c7ea1f21f48c for instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f on hv-cinder-84131 May 10 19:59:29.784636 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-22c9beb4-8230-4fc0-8533-2258b2cfe957 req-944de96c-9f3a-4c6c-b9fc-5ad10b894a8a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039542 May 10 19:59:29.785234 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 148/307] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:59:30.155022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fc05df29-7c55-4933-bda5-0256db3850ef tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:30.155637 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fc05df29-7c55-4933-bda5-0256db3850ef tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:30.161860 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fc05df29-7c55-4933-bda5-0256db3850ef tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:30.162314 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fc05df29-7c55-4933-bda5-0256db3850ef tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:30.163132 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fc05df29-7c55-4933-bda5-0256db3850ef tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:30.163561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fc05df29-7c55-4933-bda5-0256db3850ef tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:30.291787 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fc05df29-7c55-4933-bda5-0256db3850ef tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:30.299161 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fc05df29-7c55-4933-bda5-0256db3850ef tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.147969 May 10 19:59:30.299679 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 160/308] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:30 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:31.316650 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9c4d66e8-d4bb-47ab-87a1-d0d13cd3c8e9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:31.317275 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9c4d66e8-d4bb-47ab-87a1-d0d13cd3c8e9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:31.323829 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c4d66e8-d4bb-47ab-87a1-d0d13cd3c8e9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:31.324282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c4d66e8-d4bb-47ab-87a1-d0d13cd3c8e9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:31.325051 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c4d66e8-d4bb-47ab-87a1-d0d13cd3c8e9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:31.325494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c4d66e8-d4bb-47ab-87a1-d0d13cd3c8e9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:31.455784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9c4d66e8-d4bb-47ab-87a1-d0d13cd3c8e9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:31.463034 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9c4d66e8-d4bb-47ab-87a1-d0d13cd3c8e9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1264 microversion: 2.1 time: 0.150737 May 10 19:59:31.463609 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 149/309] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:31 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:32.480313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-89022feb-e115-4cb0-bdd8-08bd8e892b6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:32.480923 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-89022feb-e115-4cb0-bdd8-08bd8e892b6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:32.487217 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89022feb-e115-4cb0-bdd8-08bd8e892b6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:32.487672 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89022feb-e115-4cb0-bdd8-08bd8e892b6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:32.488437 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89022feb-e115-4cb0-bdd8-08bd8e892b6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:32.488877 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89022feb-e115-4cb0-bdd8-08bd8e892b6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:32.615686 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-89022feb-e115-4cb0-bdd8-08bd8e892b6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:32.623224 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-89022feb-e115-4cb0-bdd8-08bd8e892b6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1451 microversion: 2.1 time: 0.146739 May 10 19:59:32.623832 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 161/310] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:32 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:32.640193 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c149aea3-06e3-45a8-95d0-bc2d7ea61f88 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:32.640810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c149aea3-06e3-45a8-95d0-bc2d7ea61f88 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:32.647132 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c149aea3-06e3-45a8-95d0-bc2d7ea61f88 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:32.647591 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c149aea3-06e3-45a8-95d0-bc2d7ea61f88 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:32.648361 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c149aea3-06e3-45a8-95d0-bc2d7ea61f88 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:32.648801 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c149aea3-06e3-45a8-95d0-bc2d7ea61f88 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:32.779449 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c149aea3-06e3-45a8-95d0-bc2d7ea61f88 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:32.786901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c149aea3-06e3-45a8-95d0-bc2d7ea61f88 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1451 microversion: 2.1 time: 0.150431 May 10 19:59:32.787481 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 150/311] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:32 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:33.027024 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-716eebca-43a4-4219-8b50-87a110ef4071 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a222dc0-1dfd-40c1-b9f6-da7f03b371fe"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:33.028003 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-716eebca-43a4-4219-8b50-87a110ef4071 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:33.034293 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-716eebca-43a4-4219-8b50-87a110ef4071 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:33.034771 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-716eebca-43a4-4219-8b50-87a110ef4071 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:33.035535 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-716eebca-43a4-4219-8b50-87a110ef4071 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:33.036041 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-716eebca-43a4-4219-8b50-87a110ef4071 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:33.277433 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-716eebca-43a4-4219-8b50-87a110ef4071 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "POST /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254667 May 10 19:59:33.278000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 162/312] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 19:59:33 2022] POST /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:59:34.461485 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-6ba1e2a2-0387-4cbd-a508-b141eb8328c6 req-c39835cb-833f-41e2-ac5e-04f628259ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e0633f-fa61-4d94-8b8b-663d1a59ed6f", "tag": "d82adb7e-2a47-4a94-aa72-c7ea1f21f48c"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:34.469674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-6ba1e2a2-0387-4cbd-a508-b141eb8328c6 req-c39835cb-833f-41e2-ac5e-04f628259ba1 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:34.470119 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-6ba1e2a2-0387-4cbd-a508-b141eb8328c6 req-c39835cb-833f-41e2-ac5e-04f628259ba1 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:34.481488 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-6ba1e2a2-0387-4cbd-a508-b141eb8328c6 req-c39835cb-833f-41e2-ac5e-04f628259ba1 service nova] Creating event network-changed:d82adb7e-2a47-4a94-aa72-c7ea1f21f48c for instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f on hv-cinder-84131 May 10 19:59:34.487147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-6ba1e2a2-0387-4cbd-a508-b141eb8328c6 req-c39835cb-833f-41e2-ac5e-04f628259ba1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028697 May 10 19:59:34.487803 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 151/313] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:59:40.760417 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-25a37528-9639-4cb0-b493-c8ad92999b29 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:40.761508 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-25a37528-9639-4cb0-b493-c8ad92999b29 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:40.767629 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25a37528-9639-4cb0-b493-c8ad92999b29 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:40.768648 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25a37528-9639-4cb0-b493-c8ad92999b29 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:40.769421 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25a37528-9639-4cb0-b493-c8ad92999b29 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:40.769887 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25a37528-9639-4cb0-b493-c8ad92999b29 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:40.794488 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-25a37528-9639-4cb0-b493-c8ad92999b29 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lazy-loading 'flavor' on Instance uuid 2f925619-022d-4541-a8ac-0c1cfd41efc0 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 19:59:40.913845 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-25a37528-9639-4cb0-b493-c8ad92999b29 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "POST /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/action" status: 200 len: 32 microversion: 2.1 time: 0.158172 May 10 19:59:40.914447 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 163/314] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 19:59:40 2022] POST /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 19:59:40.925019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d72dac26-4cd4-4cc2-8576-1356792e8984 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:40.926259 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d72dac26-4cd4-4cc2-8576-1356792e8984 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:40.932783 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d72dac26-4cd4-4cc2-8576-1356792e8984 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:40.933357 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d72dac26-4cd4-4cc2-8576-1356792e8984 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:40.934128 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d72dac26-4cd4-4cc2-8576-1356792e8984 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:40.934591 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d72dac26-4cd4-4cc2-8576-1356792e8984 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:41.140638 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d72dac26-4cd4-4cc2-8576-1356792e8984 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:41.148537 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d72dac26-4cd4-4cc2-8576-1356792e8984 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.228729 May 10 19:59:41.149344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 152/315] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:40 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:42.165765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-94f26d26-ff88-4b05-9ab9-c8ed45eeb24f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:42.166502 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-94f26d26-ff88-4b05-9ab9-c8ed45eeb24f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:42.172991 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94f26d26-ff88-4b05-9ab9-c8ed45eeb24f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:42.173443 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94f26d26-ff88-4b05-9ab9-c8ed45eeb24f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:42.174216 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94f26d26-ff88-4b05-9ab9-c8ed45eeb24f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:42.174687 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94f26d26-ff88-4b05-9ab9-c8ed45eeb24f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:42.303567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-94f26d26-ff88-4b05-9ab9-c8ed45eeb24f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:42.311340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-94f26d26-ff88-4b05-9ab9-c8ed45eeb24f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.149894 May 10 19:59:42.311916 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 164/316] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:42 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:43.328546 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-63eaf37e-ca8e-4e5d-88ad-c3d0d76f3be5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:43.329142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-63eaf37e-ca8e-4e5d-88ad-c3d0d76f3be5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:43.336000 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63eaf37e-ca8e-4e5d-88ad-c3d0d76f3be5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:43.336453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63eaf37e-ca8e-4e5d-88ad-c3d0d76f3be5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:43.337219 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63eaf37e-ca8e-4e5d-88ad-c3d0d76f3be5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:43.337655 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63eaf37e-ca8e-4e5d-88ad-c3d0d76f3be5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:43.462696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-63eaf37e-ca8e-4e5d-88ad-c3d0d76f3be5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:43.471497 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-63eaf37e-ca8e-4e5d-88ad-c3d0d76f3be5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.146241 May 10 19:59:43.472147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 153/317] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:43 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:44.488610 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e578e598-5104-42c6-8792-44d992d243bc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:44.489244 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e578e598-5104-42c6-8792-44d992d243bc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:44.495873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e578e598-5104-42c6-8792-44d992d243bc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:44.496328 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e578e598-5104-42c6-8792-44d992d243bc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:44.497094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e578e598-5104-42c6-8792-44d992d243bc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:44.497532 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e578e598-5104-42c6-8792-44d992d243bc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:44.624184 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e578e598-5104-42c6-8792-44d992d243bc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:44.634609 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e578e598-5104-42c6-8792-44d992d243bc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.149796 May 10 19:59:44.635189 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 165/318] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:44 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:45.651781 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-bd0aa3f6-da95-4ef8-a992-b302b209af6e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:45.652330 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-bd0aa3f6-da95-4ef8-a992-b302b209af6e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:45.659563 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bd0aa3f6-da95-4ef8-a992-b302b209af6e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:45.660020 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bd0aa3f6-da95-4ef8-a992-b302b209af6e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:45.660792 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bd0aa3f6-da95-4ef8-a992-b302b209af6e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:45.661233 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bd0aa3f6-da95-4ef8-a992-b302b209af6e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:46.021277 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-bd0aa3f6-da95-4ef8-a992-b302b209af6e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:46.028962 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-bd0aa3f6-da95-4ef8-a992-b302b209af6e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.381146 May 10 19:59:46.029535 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 154/319] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:45 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:47.045777 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f9bb4283-7c13-4c45-9487-dd7d47296e4f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:47.046377 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f9bb4283-7c13-4c45-9487-dd7d47296e4f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:47.052980 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f9bb4283-7c13-4c45-9487-dd7d47296e4f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:47.053439 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f9bb4283-7c13-4c45-9487-dd7d47296e4f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:47.054220 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f9bb4283-7c13-4c45-9487-dd7d47296e4f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:47.054699 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f9bb4283-7c13-4c45-9487-dd7d47296e4f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:47.180233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f9bb4283-7c13-4c45-9487-dd7d47296e4f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:47.188303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f9bb4283-7c13-4c45-9487-dd7d47296e4f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.146297 May 10 19:59:47.188876 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 166/320] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:47 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:48.205756 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-25d4be79-9b39-4f1a-8286-eba71d410333 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:48.206408 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-25d4be79-9b39-4f1a-8286-eba71d410333 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:48.212783 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-25d4be79-9b39-4f1a-8286-eba71d410333 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:48.213229 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-25d4be79-9b39-4f1a-8286-eba71d410333 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:48.213985 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-25d4be79-9b39-4f1a-8286-eba71d410333 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:48.214417 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-25d4be79-9b39-4f1a-8286-eba71d410333 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:48.336826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-25d4be79-9b39-4f1a-8286-eba71d410333 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:48.344443 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-25d4be79-9b39-4f1a-8286-eba71d410333 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.143226 May 10 19:59:48.345010 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 155/321] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:48 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:49.235150 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-52a4151f-517a-403d-8efd-fd28db3b1444 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:49.235686 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-52a4151f-517a-403d-8efd-fd28db3b1444 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:49.242330 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52a4151f-517a-403d-8efd-fd28db3b1444 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:49.242819 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52a4151f-517a-403d-8efd-fd28db3b1444 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:49.243592 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52a4151f-517a-403d-8efd-fd28db3b1444 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:49.244031 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52a4151f-517a-403d-8efd-fd28db3b1444 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:49.266570 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-52a4151f-517a-403d-8efd-fd28db3b1444 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06/ips" status: 200 len: 150 microversion: 2.1 time: 0.035280 May 10 19:59:49.267137 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 167/322] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 19:59:49 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:59:49.278099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-92b33013-c21b-438e-96f2-765236c207f0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c964e68d-b7cc-45fb-99c4-179339ced72d"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:49.279225 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-92b33013-c21b-438e-96f2-765236c207f0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:49.286201 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-92b33013-c21b-438e-96f2-765236c207f0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:49.286684 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-92b33013-c21b-438e-96f2-765236c207f0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:49.287454 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-92b33013-c21b-438e-96f2-765236c207f0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:49.287896 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-92b33013-c21b-438e-96f2-765236c207f0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:49.360867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c62bb9f1-6ac1-4d47-959f-dbd6739fa991 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:49.361487 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c62bb9f1-6ac1-4d47-959f-dbd6739fa991 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:49.365530 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-92b33013-c21b-438e-96f2-765236c207f0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Invalid volume: volume c964e68d-b7cc-45fb-99c4-179339ced72d is already attached to instances: d737aa62-3e89-4485-a6ab-65267418ce57 May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-92b33013-c21b-438e-96f2-765236c207f0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: POST /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06/os-volume_attachments HTTP/1.1 May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 74 May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 19:59:49.367335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {"volumeAttachment": {"volumeId": "c964e68d-b7cc-45fb-99c4-179339ced72d"}} May 10 19:59:49.368696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Invalid volume: volume c964e68d-b7cc-45fb-99c4-179339ced72d is already attached to instances: d737aa62-3e89-4485-a6ab-65267418ce57 May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'server_id': '48eda565-f37d-4e78-a9e2-660d73a4de06', 'body': {'volumeAttachment': {'volumeId': 'c964e68d-b7cc-45fb-99c4-179339ced72d'}}} May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c964e68d-b7cc-45fb-99c4-179339ced72d is already attached to instances: d737aa62-3e89-4485-a6ab-65267418ce57 May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:59:49.369482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c964e68d-b7cc-45fb-99c4-179339ced72d is already attached to instances: d737aa62-3e89-4485-a6ab-65267418ce57 May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:59:49.371460 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:59:49.373790 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:59:49.373790 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:59:49.373790 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:59:49.373790 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c964e68d-b7cc-45fb-99c4-179339ced72d is already attached to instances: d737aa62-3e89-4485-a6ab-65267418ce57 May 10 19:59:49.373790 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 19:59:49.374193 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c62bb9f1-6ac1-4d47-959f-dbd6739fa991 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:49.374193 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c62bb9f1-6ac1-4d47-959f-dbd6739fa991 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:49.374549 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-92b33013-c21b-438e-96f2-765236c207f0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 400 to user: Invalid volume: volume c964e68d-b7cc-45fb-99c4-179339ced72d is already attached to instances: d737aa62-3e89-4485-a6ab-65267418ce57 {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:59:49.374695 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c62bb9f1-6ac1-4d47-959f-dbd6739fa991 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:49.374833 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-92b33013-c21b-438e-96f2-765236c207f0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094728 May 10 19:59:49.374973 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c62bb9f1-6ac1-4d47-959f-dbd6739fa991 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:49.375108 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 156/323] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 19:59:49 2022] POST /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 19:59:49.378761 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a262bd89-0095-4a53-ac44-2f3543280924 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:49.379264 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a262bd89-0095-4a53-ac44-2f3543280924 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:49.385267 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a262bd89-0095-4a53-ac44-2f3543280924 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:49.385725 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a262bd89-0095-4a53-ac44-2f3543280924 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:49.386517 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a262bd89-0095-4a53-ac44-2f3543280924 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:49.386964 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a262bd89-0095-4a53-ac44-2f3543280924 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:49.412663 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a262bd89-0095-4a53-ac44-2f3543280924 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 19:59:49.496563 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a262bd89-0095-4a53-ac44-2f3543280924 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 204 len: 0 microversion: 2.1 time: 0.120901 May 10 19:59:49.497092 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 157/324] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 19:59:49 2022] DELETE /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 19:59:49.506485 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ac61a926-620e-492e-8943-93d6f9a576e4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:49.507195 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ac61a926-620e-492e-8943-93d6f9a576e4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:49.508207 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c62bb9f1-6ac1-4d47-959f-dbd6739fa991 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:49.513357 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ac61a926-620e-492e-8943-93d6f9a576e4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:49.513841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ac61a926-620e-492e-8943-93d6f9a576e4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:49.514669 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ac61a926-620e-492e-8943-93d6f9a576e4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:49.515111 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ac61a926-620e-492e-8943-93d6f9a576e4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:49.516229 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c62bb9f1-6ac1-4d47-959f-dbd6739fa991 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.159143 May 10 19:59:49.516810 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 168/325] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:49 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:59:49.645327 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ac61a926-620e-492e-8943-93d6f9a576e4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:49.652519 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ac61a926-620e-492e-8943-93d6f9a576e4 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1682 microversion: 2.1 time: 0.150935 May 10 19:59:49.653085 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 158/326] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:49 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:50.533008 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2c3738dc-69aa-4fad-bce2-20f259d1bfc2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:50.533612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2c3738dc-69aa-4fad-bce2-20f259d1bfc2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:50.539980 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c3738dc-69aa-4fad-bce2-20f259d1bfc2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:50.540422 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c3738dc-69aa-4fad-bce2-20f259d1bfc2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:50.541176 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c3738dc-69aa-4fad-bce2-20f259d1bfc2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:50.541605 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c3738dc-69aa-4fad-bce2-20f259d1bfc2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:50.664096 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2c3738dc-69aa-4fad-bce2-20f259d1bfc2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:50.668957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-63286d3c-b778-4b92-b53c-cb3c21c84a5f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:50.669573 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-63286d3c-b778-4b92-b53c-cb3c21c84a5f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:50.671899 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2c3738dc-69aa-4fad-bce2-20f259d1bfc2 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.142718 May 10 19:59:50.672478 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 169/327] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:50 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:50.676647 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63286d3c-b778-4b92-b53c-cb3c21c84a5f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:50.677105 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63286d3c-b778-4b92-b53c-cb3c21c84a5f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:50.677880 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63286d3c-b778-4b92-b53c-cb3c21c84a5f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:50.678320 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63286d3c-b778-4b92-b53c-cb3c21c84a5f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:50.802242 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-63286d3c-b778-4b92-b53c-cb3c21c84a5f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:50.809418 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-63286d3c-b778-4b92-b53c-cb3c21c84a5f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1682 microversion: 2.1 time: 0.144269 May 10 19:59:50.809989 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 159/328] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:50 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1682 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:59:50.933152 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d82539bb-1b9f-490c-ac60-1d89f2e8ade6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:50.933643 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d82539bb-1b9f-490c-ac60-1d89f2e8ade6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:50.940151 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d82539bb-1b9f-490c-ac60-1d89f2e8ade6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:50.940601 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d82539bb-1b9f-490c-ac60-1d89f2e8ade6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:50.941366 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d82539bb-1b9f-490c-ac60-1d89f2e8ade6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:50.941801 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d82539bb-1b9f-490c-ac60-1d89f2e8ade6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:51.065474 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-d82539bb-1b9f-490c-ac60-1d89f2e8ade6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lazy-loading 'services' on Instance uuid c1defef6-465d-4f6b-8217-bf739e977b8f {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 19:59:51.177212 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d82539bb-1b9f-490c-ac60-1d89f2e8ade6 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/os-volume_attachments/a905d24f-2945-4de6-ad51-0917f656fec2" status: 202 len: 0 microversion: 2.1 time: 0.247757 May 10 19:59:51.177982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 170/329] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 19:59:50 2022] DELETE /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/os-volume_attachments/a905d24f-2945-4de6-ad51-0917f656fec2 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 19:59:51.689316 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7b249299-4a0c-42bc-be4f-e2630e35cd3b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:51.690145 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7b249299-4a0c-42bc-be4f-e2630e35cd3b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:51.696720 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b249299-4a0c-42bc-be4f-e2630e35cd3b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:51.697178 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b249299-4a0c-42bc-be4f-e2630e35cd3b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:51.697953 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b249299-4a0c-42bc-be4f-e2630e35cd3b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:51.698393 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b249299-4a0c-42bc-be4f-e2630e35cd3b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:51.827743 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-db01ff80-d4b1-47b3-b2af-8ddc414a1696 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:51.828442 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-db01ff80-d4b1-47b3-b2af-8ddc414a1696 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:51.835826 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db01ff80-d4b1-47b3-b2af-8ddc414a1696 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:51.836278 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db01ff80-d4b1-47b3-b2af-8ddc414a1696 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:51.837048 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db01ff80-d4b1-47b3-b2af-8ddc414a1696 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:51.837479 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db01ff80-d4b1-47b3-b2af-8ddc414a1696 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:51.910860 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-db01ff80-d4b1-47b3-b2af-8ddc414a1696 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:51.911662 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7b249299-4a0c-42bc-be4f-e2630e35cd3b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:51.918862 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-db01ff80-d4b1-47b3-b2af-8ddc414a1696 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 200 len: 1615 microversion: 2.1 time: 0.095164 May 10 19:59:51.926817 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7b249299-4a0c-42bc-be4f-e2630e35cd3b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.237163 May 10 19:59:51.927535 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 160/330] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:51 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:51.930091 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 171/331] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:51 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 1615 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:52.145077 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-273e8e79-2d57-4ac0-99c6-74002dd89d98 req-7a160b27-492d-4822-a0a9-6ad752e5e922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48eda565-f37d-4e78-a9e2-660d73a4de06", "name": "network-vif-deleted", "tag": "2363e0cc-7730-434b-b019-c5496e668908"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:52.153980 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-273e8e79-2d57-4ac0-99c6-74002dd89d98 req-7a160b27-492d-4822-a0a9-6ad752e5e922 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:52.154423 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-273e8e79-2d57-4ac0-99c6-74002dd89d98 req-7a160b27-492d-4822-a0a9-6ad752e5e922 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:52.167913 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-273e8e79-2d57-4ac0-99c6-74002dd89d98 req-7a160b27-492d-4822-a0a9-6ad752e5e922 service nova] Creating event network-vif-deleted:2363e0cc-7730-434b-b019-c5496e668908 for instance 48eda565-f37d-4e78-a9e2-660d73a4de06 on hv-cinder-84131 May 10 19:59:52.173214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-273e8e79-2d57-4ac0-99c6-74002dd89d98 req-7a160b27-492d-4822-a0a9-6ad752e5e922 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032020 May 10 19:59:52.174702 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 161/332] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:59:52.307054 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-792f4d6e-6c30-408f-8e9f-f2cfe843132f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:52.313354 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-792f4d6e-6c30-408f-8e9f-f2cfe843132f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:52.313884 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-792f4d6e-6c30-408f-8e9f-f2cfe843132f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:52.376262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-792f4d6e-6c30-408f-8e9f-f2cfe843132f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Going to try to stop instance {{(pid=117125) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 19:59:52.420324 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-792f4d6e-6c30-408f-8e9f-f2cfe843132f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "POST /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/action" status: 202 len: 0 microversion: 2.1 time: 0.117278 May 10 19:59:52.421151 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 172/333] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 19:59:52 2022] POST /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 19:59:52.430133 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3d4739df-7bc5-4852-9ace-7917fee23eb1 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:52.430886 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3d4739df-7bc5-4852-9ace-7917fee23eb1 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:52.436995 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3d4739df-7bc5-4852-9ace-7917fee23eb1 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:52.437450 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3d4739df-7bc5-4852-9ace-7917fee23eb1 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:52.438213 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3d4739df-7bc5-4852-9ace-7917fee23eb1 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:52.438671 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3d4739df-7bc5-4852-9ace-7917fee23eb1 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:52.584016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3d4739df-7bc5-4852-9ace-7917fee23eb1 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:52.600744 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3d4739df-7bc5-4852-9ace-7917fee23eb1 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1677 microversion: 2.1 time: 0.174765 May 10 19:59:52.601987 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 162/334] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:52 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:52.937625 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bca3544b-5903-4199-9593-8535c682308b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:52.938319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bca3544b-5903-4199-9593-8535c682308b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:52.944850 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bca3544b-5903-4199-9593-8535c682308b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:52.945014 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5b59942c-a3f3-4bba-a5f2-5366f79c3a1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:52.945414 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bca3544b-5903-4199-9593-8535c682308b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:52.945509 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5b59942c-a3f3-4bba-a5f2-5366f79c3a1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:52.946419 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bca3544b-5903-4199-9593-8535c682308b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:52.947230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bca3544b-5903-4199-9593-8535c682308b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:52.951708 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5b59942c-a3f3-4bba-a5f2-5366f79c3a1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:52.952439 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5b59942c-a3f3-4bba-a5f2-5366f79c3a1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:52.953443 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5b59942c-a3f3-4bba-a5f2-5366f79c3a1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:52.954094 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5b59942c-a3f3-4bba-a5f2-5366f79c3a1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:52.964777 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-bca3544b-5903-4199-9593-8535c682308b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bca3544b-5903-4199-9593-8535c682308b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 HTTP/1.1 May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 19:59:52.966626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 19:59:52.967891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '48eda565-f37d-4e78-a9e2-660d73a4de06'} May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 19:59:52.968583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 19:59:52.970164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 19:59:52.971858 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bca3544b-5903-4199-9593-8535c682308b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 19:59:52.971858 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bca3544b-5903-4199-9593-8535c682308b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 404 len: 111 microversion: 2.1 time: 0.035604 May 10 19:59:52.971858 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 173/335] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:52 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 19:59:52.979366 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-18da8d40-e75c-4dc7-a7a8-dc072140540f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '.version_select at 0x7fdd3942c9d0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:53.002424 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-18da8d40-e75c-4dc7-a7a8-dc072140540f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940784930" status: 202 len: 0 microversion: 2.1 time: 0.027093 May 10 19:59:53.003435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 174/336] 10.222.0.57 () {58 vars in 1220 bytes} [Tue May 10 19:59:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940784930 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 19:59:53.177633 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5b59942c-a3f3-4bba-a5f2-5366f79c3a1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:53.197291 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5b59942c-a3f3-4bba-a5f2-5366f79c3a1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.256948 May 10 19:59:53.198412 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 163/337] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:52 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:53.619088 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3022fbd5-c41b-44f6-b1bc-a36d4fdf305e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:53.619898 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3022fbd5-c41b-44f6-b1bc-a36d4fdf305e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:53.631447 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3022fbd5-c41b-44f6-b1bc-a36d4fdf305e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:53.631885 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3022fbd5-c41b-44f6-b1bc-a36d4fdf305e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:53.632670 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3022fbd5-c41b-44f6-b1bc-a36d4fdf305e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:53.633108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3022fbd5-c41b-44f6-b1bc-a36d4fdf305e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:53.777798 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3022fbd5-c41b-44f6-b1bc-a36d4fdf305e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:53.779912 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1a4769ee-88ff-4f59-bcbc-a4d5a12de174 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:53.780416 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1a4769ee-88ff-4f59-bcbc-a4d5a12de174 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:53.785739 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3022fbd5-c41b-44f6-b1bc-a36d4fdf305e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1677 microversion: 2.1 time: 0.171050 May 10 19:59:53.786520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 175/338] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:53 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:53.786647 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1a4769ee-88ff-4f59-bcbc-a4d5a12de174 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:53.787131 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1a4769ee-88ff-4f59-bcbc-a4d5a12de174 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:53.787885 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1a4769ee-88ff-4f59-bcbc-a4d5a12de174 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:53.788321 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1a4769ee-88ff-4f59-bcbc-a4d5a12de174 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:53.910705 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-1a4769ee-88ff-4f59-bcbc-a4d5a12de174 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lazy-loading 'services' on Instance uuid d737aa62-3e89-4485-a6ab-65267418ce57 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 19:59:54.022320 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1a4769ee-88ff-4f59-bcbc-a4d5a12de174 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/os-volume_attachments/c964e68d-b7cc-45fb-99c4-179339ced72d" status: 202 len: 0 microversion: 2.1 time: 0.246102 May 10 19:59:54.023599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 164/339] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 19:59:53 2022] DELETE /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/os-volume_attachments/c964e68d-b7cc-45fb-99c4-179339ced72d => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 19:59:54.031933 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7dc1d331-8208-4add-a46c-a73eab61ba6d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:54.033726 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7dc1d331-8208-4add-a46c-a73eab61ba6d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:54.040454 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7dc1d331-8208-4add-a46c-a73eab61ba6d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:54.041022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7dc1d331-8208-4add-a46c-a73eab61ba6d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:54.041690 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7dc1d331-8208-4add-a46c-a73eab61ba6d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:54.042132 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7dc1d331-8208-4add-a46c-a73eab61ba6d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:54.073846 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7dc1d331-8208-4add-a46c-a73eab61ba6d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 May 10 19:59:54.077828 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 176/340] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 19:59:54 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 19:59:54.216978 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5d06d98b-57bf-4d94-98ee-df6214f5a244 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:54.217672 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5d06d98b-57bf-4d94-98ee-df6214f5a244 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:54.224365 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5d06d98b-57bf-4d94-98ee-df6214f5a244 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:54.224755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5d06d98b-57bf-4d94-98ee-df6214f5a244 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:54.225513 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5d06d98b-57bf-4d94-98ee-df6214f5a244 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:54.225946 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5d06d98b-57bf-4d94-98ee-df6214f5a244 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:54.360676 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5d06d98b-57bf-4d94-98ee-df6214f5a244 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:54.369081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5d06d98b-57bf-4d94-98ee-df6214f5a244 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.156253 May 10 19:59:54.369669 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 165/341] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:54 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:54.802083 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-faba57b3-1057-4eb3-ad6b-5c2966a1c309 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:54.802830 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-faba57b3-1057-4eb3-ad6b-5c2966a1c309 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:54.808648 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-faba57b3-1057-4eb3-ad6b-5c2966a1c309 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:54.809096 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-faba57b3-1057-4eb3-ad6b-5c2966a1c309 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:54.809857 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-faba57b3-1057-4eb3-ad6b-5c2966a1c309 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:54.810288 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-faba57b3-1057-4eb3-ad6b-5c2966a1c309 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:54.938520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-faba57b3-1057-4eb3-ad6b-5c2966a1c309 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:54.947167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-faba57b3-1057-4eb3-ad6b-5c2966a1c309 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1677 microversion: 2.1 time: 0.148991 May 10 19:59:54.947743 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 177/342] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:54 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:55.086215 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e815103c-90ec-403a-a773-20392b847981 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:55.087417 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e815103c-90ec-403a-a773-20392b847981 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:55.093734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e815103c-90ec-403a-a773-20392b847981 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:55.094192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e815103c-90ec-403a-a773-20392b847981 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:55.094996 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e815103c-90ec-403a-a773-20392b847981 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:55.095441 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e815103c-90ec-403a-a773-20392b847981 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:55.126385 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e815103c-90ec-403a-a773-20392b847981 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044160 May 10 19:59:55.127566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 166/343] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 19:59:55 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 19:59:55.186174 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4609ab71-24cc-42f7-8e94-17ac893988dc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:55.186716 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4609ab71-24cc-42f7-8e94-17ac893988dc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:55.194214 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4609ab71-24cc-42f7-8e94-17ac893988dc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:55.194707 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4609ab71-24cc-42f7-8e94-17ac893988dc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:55.195488 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4609ab71-24cc-42f7-8e94-17ac893988dc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:55.195927 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4609ab71-24cc-42f7-8e94-17ac893988dc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:55.220380 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4609ab71-24cc-42f7-8e94-17ac893988dc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 19:59:55.299880 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4609ab71-24cc-42f7-8e94-17ac893988dc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 204 len: 0 microversion: 2.1 time: 0.117185 May 10 19:59:55.300529 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 178/344] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 19:59:55 2022] DELETE /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 19:59:55.308814 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-48414ce9-1bb2-4514-bb22-a1d29b451db5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:55.309430 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-48414ce9-1bb2-4514-bb22-a1d29b451db5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:55.315792 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48414ce9-1bb2-4514-bb22-a1d29b451db5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:55.316437 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48414ce9-1bb2-4514-bb22-a1d29b451db5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:55.317208 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48414ce9-1bb2-4514-bb22-a1d29b451db5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:55.317653 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48414ce9-1bb2-4514-bb22-a1d29b451db5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:55.387249 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f6c361d3-9359-4ce4-aeff-4ddefd2b3ea7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:55.387959 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f6c361d3-9359-4ce4-aeff-4ddefd2b3ea7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:55.393799 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6c361d3-9359-4ce4-aeff-4ddefd2b3ea7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:55.394260 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6c361d3-9359-4ce4-aeff-4ddefd2b3ea7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:55.395064 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6c361d3-9359-4ce4-aeff-4ddefd2b3ea7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:55.395504 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6c361d3-9359-4ce4-aeff-4ddefd2b3ea7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:55.443525 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-48414ce9-1bb2-4514-bb22-a1d29b451db5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:55.450954 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-48414ce9-1bb2-4514-bb22-a1d29b451db5 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1682 microversion: 2.1 time: 0.145859 May 10 19:59:55.451433 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 167/345] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:55 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:59:55.524393 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f6c361d3-9359-4ce4-aeff-4ddefd2b3ea7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:55.532523 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f6c361d3-9359-4ce4-aeff-4ddefd2b3ea7 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.149449 May 10 19:59:55.533613 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 179/346] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:55 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:59:55.964338 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6fdb25b9-a0fc-4fa1-b94c-32a75a1bf504 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:55.964943 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6fdb25b9-a0fc-4fa1-b94c-32a75a1bf504 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:55.971515 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6fdb25b9-a0fc-4fa1-b94c-32a75a1bf504 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:55.971960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6fdb25b9-a0fc-4fa1-b94c-32a75a1bf504 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:55.972711 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6fdb25b9-a0fc-4fa1-b94c-32a75a1bf504 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:55.973171 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6fdb25b9-a0fc-4fa1-b94c-32a75a1bf504 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:56.101238 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6fdb25b9-a0fc-4fa1-b94c-32a75a1bf504 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:56.108543 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6fdb25b9-a0fc-4fa1-b94c-32a75a1bf504 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1677 microversion: 2.1 time: 0.148054 May 10 19:59:56.109116 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 168/347] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:55 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:56.467441 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-87fb152a-2954-4490-9d57-f419aad9d419 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:56.468080 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-87fb152a-2954-4490-9d57-f419aad9d419 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:56.474898 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87fb152a-2954-4490-9d57-f419aad9d419 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:56.475344 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87fb152a-2954-4490-9d57-f419aad9d419 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:56.476097 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87fb152a-2954-4490-9d57-f419aad9d419 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:56.476529 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87fb152a-2954-4490-9d57-f419aad9d419 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:56.550804 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-021ea40c-fd84-4b1e-816f-eded3c7fdc6a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:56.551423 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-021ea40c-fd84-4b1e-816f-eded3c7fdc6a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:56.557247 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-021ea40c-fd84-4b1e-816f-eded3c7fdc6a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:56.557707 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-021ea40c-fd84-4b1e-816f-eded3c7fdc6a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:56.558531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-021ea40c-fd84-4b1e-816f-eded3c7fdc6a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:56.558979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-021ea40c-fd84-4b1e-816f-eded3c7fdc6a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:56.603410 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-87fb152a-2954-4490-9d57-f419aad9d419 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:56.610624 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-87fb152a-2954-4490-9d57-f419aad9d419 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1682 microversion: 2.1 time: 0.146997 May 10 19:59:56.611227 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 180/348] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:56 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:56.684428 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-021ea40c-fd84-4b1e-816f-eded3c7fdc6a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:56.692166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-021ea40c-fd84-4b1e-816f-eded3c7fdc6a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.145910 May 10 19:59:56.692746 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 169/349] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:56 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:59:57.125314 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d817cefe-8640-4944-9142-ab8e59989913 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:57.125926 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d817cefe-8640-4944-9142-ab8e59989913 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:57.132386 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d817cefe-8640-4944-9142-ab8e59989913 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:57.132862 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d817cefe-8640-4944-9142-ab8e59989913 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:57.133618 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d817cefe-8640-4944-9142-ab8e59989913 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:57.134079 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d817cefe-8640-4944-9142-ab8e59989913 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:57.260763 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d817cefe-8640-4944-9142-ab8e59989913 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:57.268596 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d817cefe-8640-4944-9142-ab8e59989913 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1677 microversion: 2.1 time: 0.147187 May 10 19:59:57.269164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 181/350] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:57 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:57.628552 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-766f2892-9868-4199-ae98-156e9ff353ae tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:57.629188 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-766f2892-9868-4199-ae98-156e9ff353ae tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:57.635471 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-766f2892-9868-4199-ae98-156e9ff353ae tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:57.635920 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-766f2892-9868-4199-ae98-156e9ff353ae tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:57.636678 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-766f2892-9868-4199-ae98-156e9ff353ae tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:57.637109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-766f2892-9868-4199-ae98-156e9ff353ae tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:57.709091 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cafc61cd-bab0-4e3b-b463-dc054f2fd7a3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:57.709702 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cafc61cd-bab0-4e3b-b463-dc054f2fd7a3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:57.716008 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cafc61cd-bab0-4e3b-b463-dc054f2fd7a3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:57.716470 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cafc61cd-bab0-4e3b-b463-dc054f2fd7a3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:57.717249 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cafc61cd-bab0-4e3b-b463-dc054f2fd7a3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:57.717687 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cafc61cd-bab0-4e3b-b463-dc054f2fd7a3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:57.764889 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-766f2892-9868-4199-ae98-156e9ff353ae tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:57.772230 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-766f2892-9868-4199-ae98-156e9ff353ae tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1682 microversion: 2.1 time: 0.148128 May 10 19:59:57.772806 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 170/351] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:57 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:57.842671 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cafc61cd-bab0-4e3b-b463-dc054f2fd7a3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:57.850834 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cafc61cd-bab0-4e3b-b463-dc054f2fd7a3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.145589 May 10 19:59:57.851403 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 182/352] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:57 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:59:58.285586 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-76b995c6-3034-4fe2-aff4-eead42f1c221 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:58.286208 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-76b995c6-3034-4fe2-aff4-eead42f1c221 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:58.292053 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76b995c6-3034-4fe2-aff4-eead42f1c221 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:58.292513 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76b995c6-3034-4fe2-aff4-eead42f1c221 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:58.293295 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76b995c6-3034-4fe2-aff4-eead42f1c221 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:58.293738 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76b995c6-3034-4fe2-aff4-eead42f1c221 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:58.525505 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-76b995c6-3034-4fe2-aff4-eead42f1c221 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:58.533413 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-76b995c6-3034-4fe2-aff4-eead42f1c221 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1677 microversion: 2.1 time: 0.251168 May 10 19:59:58.533991 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 171/353] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:58 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1677 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:58.789730 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-426dccf7-0b96-4bd9-addd-68aa488b591c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:58.790359 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-426dccf7-0b96-4bd9-addd-68aa488b591c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:58.796494 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-426dccf7-0b96-4bd9-addd-68aa488b591c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:58.797024 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-426dccf7-0b96-4bd9-addd-68aa488b591c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:58.797855 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-426dccf7-0b96-4bd9-addd-68aa488b591c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:58.799112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-426dccf7-0b96-4bd9-addd-68aa488b591c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:58.858870 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-426dccf7-0b96-4bd9-addd-68aa488b591c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:58.867769 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-426dccf7-0b96-4bd9-addd-68aa488b591c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1615 microversion: 2.1 time: 0.081886 May 10 19:59:58.867958 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-42b3ec21-4067-46cc-b237-e702d833e7b5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:58.868493 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-42b3ec21-4067-46cc-b237-e702d833e7b5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:58.875120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42b3ec21-4067-46cc-b237-e702d833e7b5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:58.875577 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42b3ec21-4067-46cc-b237-e702d833e7b5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:58.876352 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42b3ec21-4067-46cc-b237-e702d833e7b5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:58.876825 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42b3ec21-4067-46cc-b237-e702d833e7b5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:58.877558 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 183/354] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:58 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:59.010574 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-f7f28d4b-9e2f-4cb0-badd-650f10c490a2 req-9daff194-874b-4ffa-80ff-eb102fda196d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d737aa62-3e89-4485-a6ab-65267418ce57", "name": "network-vif-deleted", "tag": "0a9bb9dc-c69c-46b7-952b-c75f126c69a0"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 19:59:59.020837 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-f7f28d4b-9e2f-4cb0-badd-650f10c490a2 req-9daff194-874b-4ffa-80ff-eb102fda196d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:59.021383 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-f7f28d4b-9e2f-4cb0-badd-650f10c490a2 req-9daff194-874b-4ffa-80ff-eb102fda196d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:59.047680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-f7f28d4b-9e2f-4cb0-badd-650f10c490a2 req-9daff194-874b-4ffa-80ff-eb102fda196d service nova] Creating event network-vif-deleted:0a9bb9dc-c69c-46b7-952b-c75f126c69a0 for instance d737aa62-3e89-4485-a6ab-65267418ce57 on hv-cinder-84131 May 10 19:59:59.056717 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-f7f28d4b-9e2f-4cb0-badd-650f10c490a2 req-9daff194-874b-4ffa-80ff-eb102fda196d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049605 May 10 19:59:59.058157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 184/355] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 19:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 19:59:59.065693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-42b3ec21-4067-46cc-b237-e702d833e7b5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:59.081087 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-42b3ec21-4067-46cc-b237-e702d833e7b5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1735 microversion: 2.1 time: 0.217802 May 10 19:59:59.090585 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 172/356] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:58 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 19:59:59.552021 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-81e371a5-2666-4635-b2b7-5ed1aa3c7c3c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:59.552815 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-81e371a5-2666-4635-b2b7-5ed1aa3c7c3c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:59.559216 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81e371a5-2666-4635-b2b7-5ed1aa3c7c3c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:59.559821 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81e371a5-2666-4635-b2b7-5ed1aa3c7c3c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:59.560672 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81e371a5-2666-4635-b2b7-5ed1aa3c7c3c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:59.561322 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81e371a5-2666-4635-b2b7-5ed1aa3c7c3c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:59.716222 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-81e371a5-2666-4635-b2b7-5ed1aa3c7c3c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:59.723988 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-81e371a5-2666-4635-b2b7-5ed1aa3c7c3c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1677 microversion: 2.1 time: 0.176748 May 10 19:59:59.724772 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 185/357] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:59 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 19:59:59.885265 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0aced857-e27e-49bc-8835-9d0e321e95fa tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 19:59:59.885878 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0aced857-e27e-49bc-8835-9d0e321e95fa tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 19:59:59.892374 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0aced857-e27e-49bc-8835-9d0e321e95fa tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:59.892831 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0aced857-e27e-49bc-8835-9d0e321e95fa tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:59.893606 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0aced857-e27e-49bc-8835-9d0e321e95fa tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:59.894049 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0aced857-e27e-49bc-8835-9d0e321e95fa tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:59.925829 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0aced857-e27e-49bc-8835-9d0e321e95fa tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 19:59:59.926286 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0aced857-e27e-49bc-8835-9d0e321e95fa tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 19:59:59.926766 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-0aced857-e27e-49bc-8835-9d0e321e95fa tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lazy-loading 'fault' on Instance uuid d737aa62-3e89-4485-a6ab-65267418ce57 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 19:59:59.969531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0aced857-e27e-49bc-8835-9d0e321e95fa tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 19:59:59.977333 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0aced857-e27e-49bc-8835-9d0e321e95fa tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 200 len: 1331 microversion: 2.1 time: 0.096076 May 10 19:59:59.977907 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 173/358] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 19:59:59 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:00.098918 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cdde0542-27a4-448d-b32f-27b89ebb49bd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:00.100088 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cdde0542-27a4-448d-b32f-27b89ebb49bd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:00.106831 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cdde0542-27a4-448d-b32f-27b89ebb49bd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:00.107291 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cdde0542-27a4-448d-b32f-27b89ebb49bd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:00.108259 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cdde0542-27a4-448d-b32f-27b89ebb49bd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:00.108704 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cdde0542-27a4-448d-b32f-27b89ebb49bd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:00.251168 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cdde0542-27a4-448d-b32f-27b89ebb49bd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:00.258939 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cdde0542-27a4-448d-b32f-27b89ebb49bd tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1715 microversion: 2.1 time: 0.164617 May 10 20:00:00.259516 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 186/359] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:00 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1715 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:00.361310 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-361d37f0-fbdc-47df-8687-138741e901d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:00.361824 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-361d37f0-fbdc-47df-8687-138741e901d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:00.367707 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-361d37f0-fbdc-47df-8687-138741e901d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:00.368174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-361d37f0-fbdc-47df-8687-138741e901d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:00.368949 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-361d37f0-fbdc-47df-8687-138741e901d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:00.369395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-361d37f0-fbdc-47df-8687-138741e901d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:00.447797 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-361d37f0-fbdc-47df-8687-138741e901d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] HTTP exception thrown: Cannot 'detach_volume' instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 while it is in vm_state rescued May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-361d37f0-fbdc-47df-8687-138741e901d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Request method failure captured: May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: DELETE /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments/8a222dc0-1dfd-40c1-b9f6-da7f03b371fe HTTP/1.1 May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNo04E0Z0Ck85gi8rn8y1lQtBLANGa8h6SePA9luVr3Mh9vwJluzvEZNvMI4J7xpX1FRp5GiMBU2GE0ovFK2LKxd8V93dEh7e7NT9bHjPShmoKFOaY_REigD35dmE73SupGZSHiej8LKf3MbyU9YaRyRdl5a32kmQxXHM4GF-5KxyQ May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 866e5dd5364e4bd980ba03f1b76aac9d May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:00:00.449404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:00:00.451024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/866e5dd5364e4bd980ba03f1b76aac9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_866e5dd5364e4bd980ba03f1b76aac9d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/866e5dd5364e4bd980ba03f1b76aac9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/866e5dd5364e4bd980ba03f1b76aac9d"}]}] May 10 20:00:00.451024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:00:00.451024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 866e5dd5364e4bd980ba03f1b76aac9d May 10 20:00:00.451024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:00:00.451024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-ServerRescueNegativeTestJSON-900477838-project May 10 20:00:00.451024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:00:00.451024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:00:00.451024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: b642ac529ee043fd894a9188f30ed026 May 10 20:00:00.451024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-900477838-project May 10 20:00:00.451024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:00:00.451024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Cannot 'detach_volume' instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 while it is in vm_state rescued May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'server_id': '2f925619-022d-4541-a8ac-0c1cfd41efc0', 'id': '8a222dc0-1dfd-40c1-b9f6-da7f03b371fe'} May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:00:00.451904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 while it is in vm_state rescued May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 while it is in vm_state rescued May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:00:00.453643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-361d37f0-fbdc-47df-8687-138741e901d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Returning 409 to user: Cannot 'detach_volume' instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 while it is in vm_state rescued {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:00:00.454994 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-361d37f0-fbdc-47df-8687-138741e901d0 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments/8a222dc0-1dfd-40c1-b9f6-da7f03b371fe" status: 409 len: 152 microversion: 2.1 time: 0.094104 May 10 20:00:00.454994 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 174/360] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 20:00:00 2022] DELETE /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments/8a222dc0-1dfd-40c1-b9f6-da7f03b371fe => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 20:00:00.459609 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6b430920-cf4d-446b-a513-8c7c2355297c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:00.460143 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6b430920-cf4d-446b-a513-8c7c2355297c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:00.465907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6b430920-cf4d-446b-a513-8c7c2355297c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:00.466365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6b430920-cf4d-446b-a513-8c7c2355297c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:00.467169 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6b430920-cf4d-446b-a513-8c7c2355297c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:00.467607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6b430920-cf4d-446b-a513-8c7c2355297c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:00.534490 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6b430920-cf4d-446b-a513-8c7c2355297c tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "POST /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/action" status: 202 len: 0 microversion: 2.1 time: 0.078117 May 10 20:00:00.535339 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 187/361] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 20:00:00 2022] POST /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:00:00.543204 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f6b9452c-f856-4fe5-bed4-d843087fc3a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:00.543815 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f6b9452c-f856-4fe5-bed4-d843087fc3a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:00.551184 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6b9452c-f856-4fe5-bed4-d843087fc3a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:00.551757 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6b9452c-f856-4fe5-bed4-d843087fc3a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:00.552734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6b9452c-f856-4fe5-bed4-d843087fc3a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:00.553269 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6b9452c-f856-4fe5-bed4-d843087fc3a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:00.742018 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-06487431-40de-450c-8275-d7e1bc319b62 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:00.742761 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-06487431-40de-450c-8275-d7e1bc319b62 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:00.749403 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-06487431-40de-450c-8275-d7e1bc319b62 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:00.749857 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-06487431-40de-450c-8275-d7e1bc319b62 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:00.750678 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-06487431-40de-450c-8275-d7e1bc319b62 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:00.751116 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-06487431-40de-450c-8275-d7e1bc319b62 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:00.887006 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-06487431-40de-450c-8275-d7e1bc319b62 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:00.900024 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-06487431-40de-450c-8275-d7e1bc319b62 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1677 microversion: 2.1 time: 0.162327 May 10 20:00:00.900828 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 188/362] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:00 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:00:00.987623 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f6b9452c-f856-4fe5-bed4-d843087fc3a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:00.994167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ce31e42f-b7d3-48a0-9849-4c1344119197 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:00.994744 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ce31e42f-b7d3-48a0-9849-4c1344119197 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:00.996234 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f6b9452c-f856-4fe5-bed4-d843087fc3a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1723 microversion: 2.1 time: 0.456731 May 10 20:00:00.996819 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 175/363] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:00 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1723 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:01.000883 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce31e42f-b7d3-48a0-9849-4c1344119197 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:01.001688 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce31e42f-b7d3-48a0-9849-4c1344119197 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:01.002153 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce31e42f-b7d3-48a0-9849-4c1344119197 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:01.002629 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce31e42f-b7d3-48a0-9849-4c1344119197 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:01.015980 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-ce31e42f-b7d3-48a0-9849-4c1344119197 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ce31e42f-b7d3-48a0-9849-4c1344119197 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 HTTP/1.1 May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:00:01.018144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:00:01.019612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': 'd737aa62-3e89-4485-a6ab-65267418ce57'} May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:00:01.020320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:00:01.021464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:00:01.022492 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ce31e42f-b7d3-48a0-9849-4c1344119197 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:00:01.022492 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ce31e42f-b7d3-48a0-9849-4c1344119197 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 404 len: 111 microversion: 2.1 time: 0.029316 May 10 20:00:01.022492 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 189/364] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:00 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:00:01.028474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-48cb2347-c14a-40e9-a997-a33c15a6ff2a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '.version_select at 0x7fdd3a47fd30>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:01.047169 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-48cb2347-c14a-40e9-a997-a33c15a6ff2a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1802312051" status: 202 len: 0 microversion: 2.1 time: 0.022391 May 10 20:00:01.048031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 176/365] 10.222.0.57 () {58 vars in 1220 bytes} [Tue May 10 20:00:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1802312051 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:00:01.775369 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fc05a89b-2aaa-4d0f-8940-231d8c6a326a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: .version_select at 0x7fdd392278b0>, body: {"keypair": {"name": "tempest-keypair-1600547393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmStzqGQqaDH0Oo3POgegW8y/G6PdMOkZzdf8ByVXi3+mnrIyy8YYe2kMXwnq6RDCiVVAyCiKFgduxlfNI2iBvS8SCUiJqV/GEU8wqb2MxvHB4y1RZ7sN3rnlfSU3QYiw=="}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:01.789309 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-fc05a89b-2aaa-4d0f-8940-231d8c6a326a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for project 477a9d7174e544efbbe7803ca7e77521. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:00:01.792981 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-fc05a89b-2aaa-4d0f-8940-231d8c6a326a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for user 2751fce03c284a91b152f545bd8c63ce and project 477a9d7174e544efbbe7803ca7e77521. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:00:01.814794 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fc05a89b-2aaa-4d0f-8940-231d8c6a326a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.042628 May 10 20:00:01.815556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 190/366] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 20:00:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:01.917612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d8f0dc4a-2ab4-495c-ae0d-8ad73f2634b9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:01.918218 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d8f0dc4a-2ab4-495c-ae0d-8ad73f2634b9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:01.925167 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8f0dc4a-2ab4-495c-ae0d-8ad73f2634b9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:01.925624 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8f0dc4a-2ab4-495c-ae0d-8ad73f2634b9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:01.926395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8f0dc4a-2ab4-495c-ae0d-8ad73f2634b9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:01.926859 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8f0dc4a-2ab4-495c-ae0d-8ad73f2634b9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:02.013422 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e0b2b1ef-ce86-4383-8483-bac327de39f1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:02.014109 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e0b2b1ef-ce86-4383-8483-bac327de39f1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:02.021046 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e0b2b1ef-ce86-4383-8483-bac327de39f1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:02.021511 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e0b2b1ef-ce86-4383-8483-bac327de39f1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:02.022297 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e0b2b1ef-ce86-4383-8483-bac327de39f1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:02.022779 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e0b2b1ef-ce86-4383-8483-bac327de39f1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:02.090390 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d8f0dc4a-2ab4-495c-ae0d-8ad73f2634b9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:02.099785 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d8f0dc4a-2ab4-495c-ae0d-8ad73f2634b9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1677 microversion: 2.1 time: 0.186365 May 10 20:00:02.112024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 177/367] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:01 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1677 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:02.159724 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e0b2b1ef-ce86-4383-8483-bac327de39f1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:02.167652 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e0b2b1ef-ce86-4383-8483-bac327de39f1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1723 microversion: 2.1 time: 0.158273 May 10 20:00:02.168322 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 191/368] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:02 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:00:03.115459 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1949062573", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c69c6345-64af-49e8-8bf3-adcceaa64462"}], "security_groups": [{"name": "tempest-securitygroup--730526634"}], "key_name": "tempest-keypair-1600547393", "user_data": "}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:03.117324 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-175ee519-f31b-44f8-9059-4e5dc4d0871a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:03.117938 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-175ee519-f31b-44f8-9059-4e5dc4d0871a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:03.124647 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-175ee519-f31b-44f8-9059-4e5dc4d0871a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:03.125099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-175ee519-f31b-44f8-9059-4e5dc4d0871a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:03.125866 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-175ee519-f31b-44f8-9059-4e5dc4d0871a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:03.126908 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-175ee519-f31b-44f8-9059-4e5dc4d0871a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:03.221749 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] validate_networks() for [('c69c6345-64af-49e8-8bf3-adcceaa64462', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:00:03.255358 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-175ee519-f31b-44f8-9059-4e5dc4d0871a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:03.262875 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-175ee519-f31b-44f8-9059-4e5dc4d0871a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1654 microversion: 2.1 time: 0.149274 May 10 20:00:03.263442 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 192/369] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:03 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:00:03.267898 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2bf0e365-1287-47c6-b370-367a6b7f9b92 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:03.268495 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2bf0e365-1287-47c6-b370-367a6b7f9b92 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:03.274433 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2bf0e365-1287-47c6-b370-367a6b7f9b92 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:03.274922 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2bf0e365-1287-47c6-b370-367a6b7f9b92 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:03.275690 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2bf0e365-1287-47c6-b370-367a6b7f9b92 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:03.276123 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2bf0e365-1287-47c6-b370-367a6b7f9b92 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:03.402273 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2bf0e365-1287-47c6-b370-367a6b7f9b92 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:03.410583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2bf0e365-1287-47c6-b370-367a6b7f9b92 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1723 microversion: 2.1 time: 0.146152 May 10 20:00:03.411158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 193/370] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:03 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:03.415594 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-42b956c2-915b-48d4-9b84-58ac0e58ac1f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:03.421278 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-42b956c2-915b-48d4-9b84-58ac0e58ac1f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:03.421798 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-42b956c2-915b-48d4-9b84-58ac0e58ac1f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:03.445407 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-42b956c2-915b-48d4-9b84-58ac0e58ac1f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Going to try to start instance {{(pid=117125) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 20:00:03.489995 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-42b956c2-915b-48d4-9b84-58ac0e58ac1f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "POST /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/action" status: 202 len: 0 microversion: 2.1 time: 0.077464 May 10 20:00:03.490569 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 194/371] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 20:00:03 2022] POST /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:00:03.500907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-274bd3ba-376d-40c1-985f-3a6f19f0ddc8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:03.501641 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-274bd3ba-376d-40c1-985f-3a6f19f0ddc8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:03.508588 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-274bd3ba-376d-40c1-985f-3a6f19f0ddc8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:03.509056 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-274bd3ba-376d-40c1-985f-3a6f19f0ddc8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:03.510235 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-274bd3ba-376d-40c1-985f-3a6f19f0ddc8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:03.510716 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-274bd3ba-376d-40c1-985f-3a6f19f0ddc8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:03.595555 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:00:03.596429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:00:03.597003 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:00:03.597509 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:00:03.598228 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:00:03.609738 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:03.611055 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:03.612022 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:03.612630 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:03.631580 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for project 477a9d7174e544efbbe7803ca7e77521. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:00:03.636251 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for user 2751fce03c284a91b152f545bd8c63ce and project 477a9d7174e544efbbe7803ca7e77521. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:00:03.647507 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:00:03.650375 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:00:03.669205 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-274bd3ba-376d-40c1-985f-3a6f19f0ddc8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:03.676689 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-274bd3ba-376d-40c1-985f-3a6f19f0ddc8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1663 microversion: 2.1 time: 0.180485 May 10 20:00:03.677278 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 195/372] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:03 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1663 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:03.699285 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8776f894-ffe7-4709-8f62-ed3ed5882f82 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.588629 May 10 20:00:03.700151 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 178/373] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:00:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:00:03.717159 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fe349722-83ca-4663-8339-9f178550870d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:03.717807 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fe349722-83ca-4663-8339-9f178550870d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:03.771386 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fe349722-83ca-4663-8339-9f178550870d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:03.780677 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fe349722-83ca-4663-8339-9f178550870d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1242 microversion: 2.1 time: 0.068777 May 10 20:00:03.781566 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 196/374] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:03 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:04.428122 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dcf0627f-d75d-4278-8861-69fccb5fced8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:04.428657 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dcf0627f-d75d-4278-8861-69fccb5fced8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:04.435173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dcf0627f-d75d-4278-8861-69fccb5fced8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:04.435698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dcf0627f-d75d-4278-8861-69fccb5fced8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:04.436456 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dcf0627f-d75d-4278-8861-69fccb5fced8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:04.436887 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dcf0627f-d75d-4278-8861-69fccb5fced8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:04.564564 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dcf0627f-d75d-4278-8861-69fccb5fced8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:04.572357 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dcf0627f-d75d-4278-8861-69fccb5fced8 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1729 microversion: 2.1 time: 0.148768 May 10 20:00:04.573029 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 179/375] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:04 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:04.588602 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-661e40f5-3227-418c-812b-68bd5dbae369 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:04.589135 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-661e40f5-3227-418c-812b-68bd5dbae369 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:04.595421 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-661e40f5-3227-418c-812b-68bd5dbae369 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:04.595880 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-661e40f5-3227-418c-812b-68bd5dbae369 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:04.596656 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-661e40f5-3227-418c-812b-68bd5dbae369 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:04.597097 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-661e40f5-3227-418c-812b-68bd5dbae369 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:04.682188 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-661e40f5-3227-418c-812b-68bd5dbae369 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097310 May 10 20:00:04.682829 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 197/376] 10.222.0.57 () {58 vars in 1274 bytes} [Tue May 10 20:00:04 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:04.694023 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9f03693e-67d1-4505-97e1-b0ffb4e41367 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:04.694574 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9f03693e-67d1-4505-97e1-b0ffb4e41367 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:04.700561 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9f03693e-67d1-4505-97e1-b0ffb4e41367 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:04.701014 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9f03693e-67d1-4505-97e1-b0ffb4e41367 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:04.701788 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9f03693e-67d1-4505-97e1-b0ffb4e41367 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:04.702232 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9f03693e-67d1-4505-97e1-b0ffb4e41367 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:04.802102 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-94a16d8d-2937-493e-9579-7218ee92afd0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:04.802806 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-94a16d8d-2937-493e-9579-7218ee92afd0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:04.809792 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94a16d8d-2937-493e-9579-7218ee92afd0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:04.810689 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94a16d8d-2937-493e-9579-7218ee92afd0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:04.811903 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94a16d8d-2937-493e-9579-7218ee92afd0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:04.812360 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94a16d8d-2937-493e-9579-7218ee92afd0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:04.840079 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9f03693e-67d1-4505-97e1-b0ffb4e41367 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:04.848638 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9f03693e-67d1-4505-97e1-b0ffb4e41367 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1663 microversion: 2.1 time: 0.158513 May 10 20:00:04.849237 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 180/377] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:04 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:05.058233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-94a16d8d-2937-493e-9579-7218ee92afd0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:05.066313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-94a16d8d-2937-493e-9579-7218ee92afd0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1302 microversion: 2.1 time: 0.271886 May 10 20:00:05.067285 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 198/378] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:04 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1302 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:00:05.846194 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-2e15717e-9309-47d3-87c4-5ad4f56315fa req-21ed5e99-138d-45a2-ad60-330a7e23d019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f925619-022d-4541-a8ac-0c1cfd41efc0", "tag": "9da24b37-2570-4ec8-b96e-7dd6c39379fc"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:05.861495 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-2e15717e-9309-47d3-87c4-5ad4f56315fa req-21ed5e99-138d-45a2-ad60-330a7e23d019 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:05.862429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-2e15717e-9309-47d3-87c4-5ad4f56315fa req-21ed5e99-138d-45a2-ad60-330a7e23d019 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:05.865900 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0eab3e92-42b6-4552-9a14-1621ffb79c20 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:05.866629 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0eab3e92-42b6-4552-9a14-1621ffb79c20 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:05.883260 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-2e15717e-9309-47d3-87c4-5ad4f56315fa req-21ed5e99-138d-45a2-ad60-330a7e23d019 service nova] Creating event network-changed:9da24b37-2570-4ec8-b96e-7dd6c39379fc for instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 on hv-cinder-84131 May 10 20:00:05.890614 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-2e15717e-9309-47d3-87c4-5ad4f56315fa req-21ed5e99-138d-45a2-ad60-330a7e23d019 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047786 May 10 20:00:05.890940 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0eab3e92-42b6-4552-9a14-1621ffb79c20 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:05.891456 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0eab3e92-42b6-4552-9a14-1621ffb79c20 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:05.892953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0eab3e92-42b6-4552-9a14-1621ffb79c20 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:05.894235 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 181/379] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:05.895714 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0eab3e92-42b6-4552-9a14-1621ffb79c20 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:06.068166 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0eab3e92-42b6-4552-9a14-1621ffb79c20 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:06.076205 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0eab3e92-42b6-4552-9a14-1621ffb79c20 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1667 microversion: 2.1 time: 0.214330 May 10 20:00:06.092867 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-91017243-40b5-4e20-b96b-ea3ad051808e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:06.093851 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-91017243-40b5-4e20-b96b-ea3ad051808e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:06.098052 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 199/380] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:05 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1667 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:00:06.106332 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91017243-40b5-4e20-b96b-ea3ad051808e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:06.107013 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91017243-40b5-4e20-b96b-ea3ad051808e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:06.109493 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91017243-40b5-4e20-b96b-ea3ad051808e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:06.111382 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91017243-40b5-4e20-b96b-ea3ad051808e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:06.437375 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-91017243-40b5-4e20-b96b-ea3ad051808e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:06.446091 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-91017243-40b5-4e20-b96b-ea3ad051808e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1367 microversion: 2.1 time: 0.357542 May 10 20:00:06.455755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 182/381] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:06 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:07.067037 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-9c4dcb09-4af0-4019-ba23-32eb54616def req-680db778-d111-4cd9-a411-bed7280625a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e180d6e-d6c1-42af-9852-5048dde008df", "tag": "559a552a-a94f-4905-8ded-b87ae9722b5b"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:07.077453 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-9c4dcb09-4af0-4019-ba23-32eb54616def req-680db778-d111-4cd9-a411-bed7280625a3 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:07.077985 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-9c4dcb09-4af0-4019-ba23-32eb54616def req-680db778-d111-4cd9-a411-bed7280625a3 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:07.093322 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-9c4dcb09-4af0-4019-ba23-32eb54616def req-680db778-d111-4cd9-a411-bed7280625a3 service nova] Creating event network-changed:559a552a-a94f-4905-8ded-b87ae9722b5b for instance 4e180d6e-d6c1-42af-9852-5048dde008df on hv-cinder-84131 May 10 20:00:07.098736 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-9c4dcb09-4af0-4019-ba23-32eb54616def req-680db778-d111-4cd9-a411-bed7280625a3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035804 May 10 20:00:07.099345 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 200/382] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:07.463389 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ce739d82-43f2-4814-b38b-b78cbd0ec161 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:07.464138 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ce739d82-43f2-4814-b38b-b78cbd0ec161 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:07.471119 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ce739d82-43f2-4814-b38b-b78cbd0ec161 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:07.471569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ce739d82-43f2-4814-b38b-b78cbd0ec161 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:07.472349 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ce739d82-43f2-4814-b38b-b78cbd0ec161 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:07.472822 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ce739d82-43f2-4814-b38b-b78cbd0ec161 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:07.603641 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ce739d82-43f2-4814-b38b-b78cbd0ec161 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:07.610877 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ce739d82-43f2-4814-b38b-b78cbd0ec161 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1367 microversion: 2.1 time: 0.151560 May 10 20:00:07.611452 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 183/383] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:07 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:07.913036 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-61c145c2-adcc-406a-8402-fc76cdc6f758 req-14bf1c45-1eda-473d-8470-bb7b0afb0c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f925619-022d-4541-a8ac-0c1cfd41efc0", "tag": "9da24b37-2570-4ec8-b96e-7dd6c39379fc"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:07.921081 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-61c145c2-adcc-406a-8402-fc76cdc6f758 req-14bf1c45-1eda-473d-8470-bb7b0afb0c3a service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:07.921518 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-61c145c2-adcc-406a-8402-fc76cdc6f758 req-14bf1c45-1eda-473d-8470-bb7b0afb0c3a service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:07.931725 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-61c145c2-adcc-406a-8402-fc76cdc6f758 req-14bf1c45-1eda-473d-8470-bb7b0afb0c3a service nova] Creating event network-changed:9da24b37-2570-4ec8-b96e-7dd6c39379fc for instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 on hv-cinder-84131 May 10 20:00:07.936355 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-61c145c2-adcc-406a-8402-fc76cdc6f758 req-14bf1c45-1eda-473d-8470-bb7b0afb0c3a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027290 May 10 20:00:07.936904 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 201/384] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:08.628411 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5f411ec7-4ff5-4808-81ae-841449214e59 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:08.629012 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5f411ec7-4ff5-4808-81ae-841449214e59 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:08.635604 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f411ec7-4ff5-4808-81ae-841449214e59 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:08.636055 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f411ec7-4ff5-4808-81ae-841449214e59 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:08.636840 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f411ec7-4ff5-4808-81ae-841449214e59 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:08.637277 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f411ec7-4ff5-4808-81ae-841449214e59 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:09.056650 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5f411ec7-4ff5-4808-81ae-841449214e59 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:09.064171 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5f411ec7-4ff5-4808-81ae-841449214e59 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1367 microversion: 2.1 time: 0.440256 May 10 20:00:09.074789 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 184/385] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:08 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1367 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:10.081969 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3b6b9b16-d7dc-4266-966c-3c598ef10f09 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:10.082762 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3b6b9b16-d7dc-4266-966c-3c598ef10f09 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:10.088813 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b6b9b16-d7dc-4266-966c-3c598ef10f09 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:10.089264 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b6b9b16-d7dc-4266-966c-3c598ef10f09 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:10.090033 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b6b9b16-d7dc-4266-966c-3c598ef10f09 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:10.090485 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b6b9b16-d7dc-4266-966c-3c598ef10f09 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:10.224131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3b6b9b16-d7dc-4266-966c-3c598ef10f09 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:10.231277 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3b6b9b16-d7dc-4266-966c-3c598ef10f09 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1367 microversion: 2.1 time: 0.153923 May 10 20:00:10.231844 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 202/386] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:10 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:11.248945 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-272e4416-ac15-4575-b685-17faaf4642c0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:11.249580 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-272e4416-ac15-4575-b685-17faaf4642c0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:11.256574 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-272e4416-ac15-4575-b685-17faaf4642c0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:11.257027 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-272e4416-ac15-4575-b685-17faaf4642c0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:11.257789 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-272e4416-ac15-4575-b685-17faaf4642c0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:11.258225 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-272e4416-ac15-4575-b685-17faaf4642c0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:11.383446 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-272e4416-ac15-4575-b685-17faaf4642c0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:11.390473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-272e4416-ac15-4575-b685-17faaf4642c0 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1367 microversion: 2.1 time: 0.145638 May 10 20:00:11.391022 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 185/387] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:11 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:11.984754 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-b29dea07-39c2-470b-bc3d-083385807ac8 req-4f36e59f-2d63-4871-95b5-1bb06f797e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e180d6e-d6c1-42af-9852-5048dde008df", "name": "network-vif-plugged", "status": "completed", "tag": "559a552a-a94f-4905-8ded-b87ae9722b5b"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:11.994131 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-b29dea07-39c2-470b-bc3d-083385807ac8 req-4f36e59f-2d63-4871-95b5-1bb06f797e1b service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:11.994905 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-b29dea07-39c2-470b-bc3d-083385807ac8 req-4f36e59f-2d63-4871-95b5-1bb06f797e1b service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:12.006531 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-b29dea07-39c2-470b-bc3d-083385807ac8 req-4f36e59f-2d63-4871-95b5-1bb06f797e1b service nova] Creating event network-vif-plugged:559a552a-a94f-4905-8ded-b87ae9722b5b for instance 4e180d6e-d6c1-42af-9852-5048dde008df on hv-cinder-84131 May 10 20:00:12.011332 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-b29dea07-39c2-470b-bc3d-083385807ac8 req-4f36e59f-2d63-4871-95b5-1bb06f797e1b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030592 May 10 20:00:12.011922 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 203/388] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:12.407223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3087c263-af5c-4f4c-9e80-14810b2cc126 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:12.407836 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3087c263-af5c-4f4c-9e80-14810b2cc126 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:12.414050 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3087c263-af5c-4f4c-9e80-14810b2cc126 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:12.414504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3087c263-af5c-4f4c-9e80-14810b2cc126 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:12.415264 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3087c263-af5c-4f4c-9e80-14810b2cc126 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:12.415695 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3087c263-af5c-4f4c-9e80-14810b2cc126 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:12.541204 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3087c263-af5c-4f4c-9e80-14810b2cc126 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:12.548379 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3087c263-af5c-4f4c-9e80-14810b2cc126 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1367 microversion: 2.1 time: 0.145096 May 10 20:00:12.548970 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 186/389] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:12 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:13.566903 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ae3ce565-fc88-480e-adba-c78ae318ec2b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:13.567618 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ae3ce565-fc88-480e-adba-c78ae318ec2b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:13.573768 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae3ce565-fc88-480e-adba-c78ae318ec2b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:13.574431 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae3ce565-fc88-480e-adba-c78ae318ec2b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:13.575486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae3ce565-fc88-480e-adba-c78ae318ec2b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:13.575912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae3ce565-fc88-480e-adba-c78ae318ec2b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:13.704573 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ae3ce565-fc88-480e-adba-c78ae318ec2b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:13.711811 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ae3ce565-fc88-480e-adba-c78ae318ec2b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1367 microversion: 2.1 time: 0.150326 May 10 20:00:13.712375 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 204/390] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:13 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:14.728717 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2e358359-af32-4c62-82f5-562dd46d19e6 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:14.729333 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2e358359-af32-4c62-82f5-562dd46d19e6 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:14.735917 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e358359-af32-4c62-82f5-562dd46d19e6 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:14.736371 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e358359-af32-4c62-82f5-562dd46d19e6 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:14.737145 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e358359-af32-4c62-82f5-562dd46d19e6 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:14.737584 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e358359-af32-4c62-82f5-562dd46d19e6 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:14.865452 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2e358359-af32-4c62-82f5-562dd46d19e6 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:14.873050 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2e358359-af32-4c62-82f5-562dd46d19e6 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1558 microversion: 2.1 time: 0.148252 May 10 20:00:14.873639 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 187/391] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:14 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:14.889629 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a66a2fac-3a09-46bd-8928-7658535ea3f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:14.890151 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a66a2fac-3a09-46bd-8928-7658535ea3f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:14.896971 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a66a2fac-3a09-46bd-8928-7658535ea3f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:14.897426 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a66a2fac-3a09-46bd-8928-7658535ea3f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:14.898199 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a66a2fac-3a09-46bd-8928-7658535ea3f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:14.898671 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a66a2fac-3a09-46bd-8928-7658535ea3f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:14.973801 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a66a2fac-3a09-46bd-8928-7658535ea3f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087995 May 10 20:00:14.974406 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 205/392] 10.222.0.57 () {58 vars in 1274 bytes} [Tue May 10 20:00:14 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:15.916876 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-e007e32c-f9f1-4768-986a-7ac7e3abd3a1 req-ee9e82d1-2096-4671-90f2-4b6ff28c924a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e180d6e-d6c1-42af-9852-5048dde008df", "tag": "559a552a-a94f-4905-8ded-b87ae9722b5b"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:15.925166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e007e32c-f9f1-4768-986a-7ac7e3abd3a1 req-ee9e82d1-2096-4671-90f2-4b6ff28c924a service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:15.925614 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e007e32c-f9f1-4768-986a-7ac7e3abd3a1 req-ee9e82d1-2096-4671-90f2-4b6ff28c924a service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:15.936426 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-e007e32c-f9f1-4768-986a-7ac7e3abd3a1 req-ee9e82d1-2096-4671-90f2-4b6ff28c924a service nova] Creating event network-changed:559a552a-a94f-4905-8ded-b87ae9722b5b for instance 4e180d6e-d6c1-42af-9852-5048dde008df on hv-cinder-84131 May 10 20:00:15.941662 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-e007e32c-f9f1-4768-986a-7ac7e3abd3a1 req-ee9e82d1-2096-4671-90f2-4b6ff28c924a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028398 May 10 20:00:15.942266 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 188/393] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:43.901733 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-12bea833-6847-46e2-9734-0a2d6a56bf4e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:43.902209 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-12bea833-6847-46e2-9734-0a2d6a56bf4e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:43.908117 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-12bea833-6847-46e2-9734-0a2d6a56bf4e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:43.908576 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-12bea833-6847-46e2-9734-0a2d6a56bf4e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:43.909337 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-12bea833-6847-46e2-9734-0a2d6a56bf4e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:43.909772 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-12bea833-6847-46e2-9734-0a2d6a56bf4e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:43.988127 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-12bea833-6847-46e2-9734-0a2d6a56bf4e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lazy-loading 'services' on Instance uuid 2f925619-022d-4541-a8ac-0c1cfd41efc0 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:00:44.057201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-12bea833-6847-46e2-9734-0a2d6a56bf4e tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments/8a222dc0-1dfd-40c1-b9f6-da7f03b371fe" status: 202 len: 0 microversion: 2.1 time: 0.159834 May 10 20:00:44.057953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 206/394] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 20:00:43 2022] DELETE /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments/8a222dc0-1dfd-40c1-b9f6-da7f03b371fe => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:00:44.067337 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fca3ee90-87a7-4c04-9752-714169056c75 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:44.068360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fca3ee90-87a7-4c04-9752-714169056c75 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:44.074645 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fca3ee90-87a7-4c04-9752-714169056c75 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:44.075107 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fca3ee90-87a7-4c04-9752-714169056c75 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:44.075891 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fca3ee90-87a7-4c04-9752-714169056c75 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:44.076333 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fca3ee90-87a7-4c04-9752-714169056c75 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:44.107451 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fca3ee90-87a7-4c04-9752-714169056c75 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 May 10 20:00:44.108041 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 189/395] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:00:44 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:44.692071 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7d70a758-e6e2-42c1-99c2-e1fa45812126 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:44.693090 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7d70a758-e6e2-42c1-99c2-e1fa45812126 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:44.699822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d70a758-e6e2-42c1-99c2-e1fa45812126 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:44.700316 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d70a758-e6e2-42c1-99c2-e1fa45812126 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:44.701094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d70a758-e6e2-42c1-99c2-e1fa45812126 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:44.701536 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d70a758-e6e2-42c1-99c2-e1fa45812126 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:44.733615 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7d70a758-e6e2-42c1-99c2-e1fa45812126 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046318 May 10 20:00:44.734177 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 207/396] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:00:44 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:00:44.790218 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d1cdc68f-56ce-4082-b36b-5789fdfec749 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:44.790685 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d1cdc68f-56ce-4082-b36b-5789fdfec749 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:44.796501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1cdc68f-56ce-4082-b36b-5789fdfec749 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:44.796980 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1cdc68f-56ce-4082-b36b-5789fdfec749 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:44.797741 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1cdc68f-56ce-4082-b36b-5789fdfec749 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:44.798240 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1cdc68f-56ce-4082-b36b-5789fdfec749 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:44.822229 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d1cdc68f-56ce-4082-b36b-5789fdfec749 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:00:44.898246 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d1cdc68f-56ce-4082-b36b-5789fdfec749 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 204 len: 0 microversion: 2.1 time: 0.111570 May 10 20:00:44.898878 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 190/397] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:00:44 2022] DELETE /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:00:44.908530 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-720d97c2-4f79-4140-b5fb-ae53b867b458 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:44.909135 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-720d97c2-4f79-4140-b5fb-ae53b867b458 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:44.915792 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-720d97c2-4f79-4140-b5fb-ae53b867b458 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:44.916745 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-720d97c2-4f79-4140-b5fb-ae53b867b458 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:44.917541 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-720d97c2-4f79-4140-b5fb-ae53b867b458 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:44.917983 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-720d97c2-4f79-4140-b5fb-ae53b867b458 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:45.043181 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-720d97c2-4f79-4140-b5fb-ae53b867b458 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:45.050950 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-720d97c2-4f79-4140-b5fb-ae53b867b458 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1673 microversion: 2.1 time: 0.147384 May 10 20:00:45.051527 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 208/398] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:44 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:00:45.119923 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-aca61736-bb88-425c-bb04-4874eb5cc882 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:45.120956 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-aca61736-bb88-425c-bb04-4874eb5cc882 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:45.127944 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aca61736-bb88-425c-bb04-4874eb5cc882 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:45.128402 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aca61736-bb88-425c-bb04-4874eb5cc882 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:45.129175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aca61736-bb88-425c-bb04-4874eb5cc882 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:45.129617 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aca61736-bb88-425c-bb04-4874eb5cc882 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:45.158030 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-aca61736-bb88-425c-bb04-4874eb5cc882 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042702 May 10 20:00:45.158625 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 191/399] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:00:45 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:46.068417 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-40442ba1-9773-4b72-853c-e7abc3d067f7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:46.069077 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-40442ba1-9773-4b72-853c-e7abc3d067f7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:46.076501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-40442ba1-9773-4b72-853c-e7abc3d067f7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:46.076960 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-40442ba1-9773-4b72-853c-e7abc3d067f7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:46.077742 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-40442ba1-9773-4b72-853c-e7abc3d067f7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:46.078188 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-40442ba1-9773-4b72-853c-e7abc3d067f7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:46.169044 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f5d17141-5685-464e-9ddd-19de6fcf9acc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:46.169892 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f5d17141-5685-464e-9ddd-19de6fcf9acc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:46.176191 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f5d17141-5685-464e-9ddd-19de6fcf9acc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:46.176640 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f5d17141-5685-464e-9ddd-19de6fcf9acc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:46.177408 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f5d17141-5685-464e-9ddd-19de6fcf9acc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:46.177840 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f5d17141-5685-464e-9ddd-19de6fcf9acc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:46.207018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f5d17141-5685-464e-9ddd-19de6fcf9acc tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041795 May 10 20:00:46.207625 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 192/400] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:00:46 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:00:46.212556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-40442ba1-9773-4b72-853c-e7abc3d067f7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:46.219940 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-40442ba1-9773-4b72-853c-e7abc3d067f7 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1673 microversion: 2.1 time: 0.155445 May 10 20:00:46.220625 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 209/401] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:46 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:47.218710 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4b38f2da-5462-4913-969a-5bfc98b1c06f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:47.219642 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4b38f2da-5462-4913-969a-5bfc98b1c06f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:47.226482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b38f2da-5462-4913-969a-5bfc98b1c06f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:47.226951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b38f2da-5462-4913-969a-5bfc98b1c06f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:47.227727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b38f2da-5462-4913-969a-5bfc98b1c06f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:47.228170 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b38f2da-5462-4913-969a-5bfc98b1c06f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:47.236280 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4cebb21c-e1d5-4122-b47e-c228a04acc2f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:47.236935 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4cebb21c-e1d5-4122-b47e-c228a04acc2f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:47.243546 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4cebb21c-e1d5-4122-b47e-c228a04acc2f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:47.244002 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4cebb21c-e1d5-4122-b47e-c228a04acc2f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:47.245052 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4cebb21c-e1d5-4122-b47e-c228a04acc2f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:47.245497 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4cebb21c-e1d5-4122-b47e-c228a04acc2f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:47.257251 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4b38f2da-5462-4913-969a-5bfc98b1c06f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042540 May 10 20:00:47.258036 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 193/402] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:00:47 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:00:47.322835 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e6f2d736-ad9a-4bf1-8276-ec52590e6c1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:47.323343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e6f2d736-ad9a-4bf1-8276-ec52590e6c1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:47.329987 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6f2d736-ad9a-4bf1-8276-ec52590e6c1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:47.330823 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6f2d736-ad9a-4bf1-8276-ec52590e6c1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:47.331587 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6f2d736-ad9a-4bf1-8276-ec52590e6c1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:47.332362 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6f2d736-ad9a-4bf1-8276-ec52590e6c1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:47.358997 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e6f2d736-ad9a-4bf1-8276-ec52590e6c1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:00:47.393729 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4cebb21c-e1d5-4122-b47e-c228a04acc2f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:47.402016 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4cebb21c-e1d5-4122-b47e-c228a04acc2f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1673 microversion: 2.1 time: 0.169520 May 10 20:00:47.402764 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 210/403] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:47 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:00:47.437702 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e6f2d736-ad9a-4bf1-8276-ec52590e6c1d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 204 len: 0 microversion: 2.1 time: 0.118411 May 10 20:00:47.438535 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 194/404] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:00:47 2022] DELETE /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:00:47.447190 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1c9b5dfe-f3cc-48ec-b63e-e18359e9fc32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:47.447901 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1c9b5dfe-f3cc-48ec-b63e-e18359e9fc32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:47.453778 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c9b5dfe-f3cc-48ec-b63e-e18359e9fc32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:47.454871 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c9b5dfe-f3cc-48ec-b63e-e18359e9fc32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:47.455716 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c9b5dfe-f3cc-48ec-b63e-e18359e9fc32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:47.456299 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c9b5dfe-f3cc-48ec-b63e-e18359e9fc32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:47.784664 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1c9b5dfe-f3cc-48ec-b63e-e18359e9fc32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:47.792165 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1c9b5dfe-f3cc-48ec-b63e-e18359e9fc32 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1689 microversion: 2.1 time: 0.349021 May 10 20:00:47.793159 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 211/405] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:47 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1689 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:48.026216 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-16dd92f5-225b-4235-a6f7-a12d0af2e293 req-64832d61-c9c2-4211-836e-fa31a2e6c6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1defef6-465d-4f6b-8217-bf739e977b8f", "name": "network-vif-deleted", "tag": "fe5765cf-11a0-4789-8584-2baf84582ea4"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:48.033980 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-16dd92f5-225b-4235-a6f7-a12d0af2e293 req-64832d61-c9c2-4211-836e-fa31a2e6c6d5 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:48.034432 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-16dd92f5-225b-4235-a6f7-a12d0af2e293 req-64832d61-c9c2-4211-836e-fa31a2e6c6d5 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:48.045677 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-16dd92f5-225b-4235-a6f7-a12d0af2e293 req-64832d61-c9c2-4211-836e-fa31a2e6c6d5 service nova] Creating event network-vif-deleted:fe5765cf-11a0-4789-8584-2baf84582ea4 for instance c1defef6-465d-4f6b-8217-bf739e977b8f on hv-cinder-84131 May 10 20:00:48.051139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-16dd92f5-225b-4235-a6f7-a12d0af2e293 req-64832d61-c9c2-4211-836e-fa31a2e6c6d5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028942 May 10 20:00:48.051748 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 195/406] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:00:48.420021 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c9ea001c-9e1c-4058-8d98-19ffe731fe12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:48.420632 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c9ea001c-9e1c-4058-8d98-19ffe731fe12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:48.427505 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c9ea001c-9e1c-4058-8d98-19ffe731fe12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:48.427959 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c9ea001c-9e1c-4058-8d98-19ffe731fe12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:48.428731 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c9ea001c-9e1c-4058-8d98-19ffe731fe12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:48.429170 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c9ea001c-9e1c-4058-8d98-19ffe731fe12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:48.490873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c9ea001c-9e1c-4058-8d98-19ffe731fe12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:48.498538 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c9ea001c-9e1c-4058-8d98-19ffe731fe12 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1605 microversion: 2.1 time: 0.082321 May 10 20:00:48.499118 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 212/407] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:48 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1605 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:48.809673 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f6ede49e-8e90-45fe-8ce7-b4b939a8fb09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:48.810413 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f6ede49e-8e90-45fe-8ce7-b4b939a8fb09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:48.817177 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6ede49e-8e90-45fe-8ce7-b4b939a8fb09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:48.817630 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6ede49e-8e90-45fe-8ce7-b4b939a8fb09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:48.818418 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6ede49e-8e90-45fe-8ce7-b4b939a8fb09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:48.819015 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6ede49e-8e90-45fe-8ce7-b4b939a8fb09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:48.960205 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f6ede49e-8e90-45fe-8ce7-b4b939a8fb09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:48.967896 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f6ede49e-8e90-45fe-8ce7-b4b939a8fb09 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1689 microversion: 2.1 time: 0.162432 May 10 20:00:48.968488 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 196/408] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:48 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:49.515522 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bc522270-a5c8-4c0d-a5f1-5de6be9afc5f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:49.516148 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bc522270-a5c8-4c0d-a5f1-5de6be9afc5f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:49.522591 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc522270-a5c8-4c0d-a5f1-5de6be9afc5f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:49.523060 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc522270-a5c8-4c0d-a5f1-5de6be9afc5f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:49.523822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc522270-a5c8-4c0d-a5f1-5de6be9afc5f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:49.524281 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc522270-a5c8-4c0d-a5f1-5de6be9afc5f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:49.583798 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bc522270-a5c8-4c0d-a5f1-5de6be9afc5f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:49.591055 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bc522270-a5c8-4c0d-a5f1-5de6be9afc5f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1605 microversion: 2.1 time: 0.079405 May 10 20:00:49.591624 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 213/409] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:49 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1605 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:49.986303 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-83e09298-afd7-492c-87bb-692b8abc0642 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:49.986951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-83e09298-afd7-492c-87bb-692b8abc0642 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:49.993619 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83e09298-afd7-492c-87bb-692b8abc0642 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:49.994086 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83e09298-afd7-492c-87bb-692b8abc0642 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:49.995140 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83e09298-afd7-492c-87bb-692b8abc0642 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:49.995581 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83e09298-afd7-492c-87bb-692b8abc0642 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:50.124409 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-83e09298-afd7-492c-87bb-692b8abc0642 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:50.131700 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-83e09298-afd7-492c-87bb-692b8abc0642 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1689 microversion: 2.1 time: 0.149954 May 10 20:00:50.132268 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 197/410] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:49 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:50.607887 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-43650436-1c51-4b0c-96d0-02695fd3129d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:50.608523 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-43650436-1c51-4b0c-96d0-02695fd3129d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:50.614864 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-43650436-1c51-4b0c-96d0-02695fd3129d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:50.615401 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-43650436-1c51-4b0c-96d0-02695fd3129d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:50.616184 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-43650436-1c51-4b0c-96d0-02695fd3129d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:50.616604 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-43650436-1c51-4b0c-96d0-02695fd3129d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:50.676308 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-43650436-1c51-4b0c-96d0-02695fd3129d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:50.683419 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-43650436-1c51-4b0c-96d0-02695fd3129d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 200 len: 1605 microversion: 2.1 time: 0.079351 May 10 20:00:50.683986 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 214/411] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:50 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 1605 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:51.149150 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a063e309-cdff-4a8c-865e-677b2110cb1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:51.149765 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a063e309-cdff-4a8c-865e-677b2110cb1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:51.156071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a063e309-cdff-4a8c-865e-677b2110cb1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:51.156528 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a063e309-cdff-4a8c-865e-677b2110cb1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:51.157961 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a063e309-cdff-4a8c-865e-677b2110cb1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:51.158404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a063e309-cdff-4a8c-865e-677b2110cb1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:51.281987 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a063e309-cdff-4a8c-865e-677b2110cb1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:51.291990 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a063e309-cdff-4a8c-865e-677b2110cb1f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1689 microversion: 2.1 time: 0.146667 May 10 20:00:51.292786 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 198/412] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:51 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:51.700578 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bb5cdb16-7f8d-4e9a-8872-1fc4dec3e2e5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:51.701271 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bb5cdb16-7f8d-4e9a-8872-1fc4dec3e2e5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:51.707724 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb5cdb16-7f8d-4e9a-8872-1fc4dec3e2e5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:51.708247 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb5cdb16-7f8d-4e9a-8872-1fc4dec3e2e5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:51.709078 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb5cdb16-7f8d-4e9a-8872-1fc4dec3e2e5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:51.709583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb5cdb16-7f8d-4e9a-8872-1fc4dec3e2e5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:51.722967 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-bb5cdb16-7f8d-4e9a-8872-1fc4dec3e2e5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] HTTP exception thrown: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bb5cdb16-7f8d-4e9a-8872-1fc4dec3e2e5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Request method failure captured: May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f HTTP/1.1 May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNoatTMjL14OZuypFaXFv6yw-vdGHhlNY6cl9L2HKfC10hJs0GATwm31NDsRjpdi03jV5xt-0NHnBmVEY4o-X3FfWIc2xzPr7hpWu3AnhjpJV2fAHYmCNi9HNe2Ch8iOxAYm5C3DXH7eekXB83q49WbUVUIurPfDf0VeblppvIHg4s May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:00:51.724621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bfb1f4857a6e438e87e546dfd1d8a8b9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}] May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeTestJSON-1447019700 May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 0b7dead8216e4cd59eaa15ad8842e38a May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:00:51.725924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': 'c1defef6-465d-4f6b-8217-bf739e977b8f'} May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:00:51.726759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:00:51.728012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:00:51.729094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bb5cdb16-7f8d-4e9a-8872-1fc4dec3e2e5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Returning 404 to user: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:00:51.729094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bb5cdb16-7f8d-4e9a-8872-1fc4dec3e2e5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 404 len: 111 microversion: 2.1 time: 0.029296 May 10 20:00:51.729094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 215/413] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:51 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:00:51.736015 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f8859eab-323c-45e4-bd34-09fdb5e45d43 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '.version_select at 0x7fdd39b22430>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:51.753672 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f8859eab-323c-45e4-bd34-09fdb5e45d43 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-151716783" status: 202 len: 0 microversion: 2.1 time: 0.022183 May 10 20:00:51.757558 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 199/414] 10.222.0.57 () {58 vars in 1217 bytes} [Tue May 10 20:00:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-151716783 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:00:52.309507 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e358dd81-5978-4373-9342-352fe3274309 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:52.310292 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e358dd81-5978-4373-9342-352fe3274309 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:52.317794 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e358dd81-5978-4373-9342-352fe3274309 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:52.318279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e358dd81-5978-4373-9342-352fe3274309 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:52.319190 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e358dd81-5978-4373-9342-352fe3274309 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:52.319633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e358dd81-5978-4373-9342-352fe3274309 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:52.385519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e358dd81-5978-4373-9342-352fe3274309 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:52.394282 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e358dd81-5978-4373-9342-352fe3274309 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 200 len: 1621 microversion: 2.1 time: 0.088966 May 10 20:00:52.395172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 216/415] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:52 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 1621 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:52.569454 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-22a53a86-75b6-409c-a513-2b3e3b9838af req-12184697-1aab-4aab-a0db-78bc33e39b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f925619-022d-4541-a8ac-0c1cfd41efc0", "name": "network-vif-deleted", "tag": "9da24b37-2570-4ec8-b96e-7dd6c39379fc"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:52.578862 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-22a53a86-75b6-409c-a513-2b3e3b9838af req-12184697-1aab-4aab-a0db-78bc33e39b9f service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:52.579300 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-22a53a86-75b6-409c-a513-2b3e3b9838af req-12184697-1aab-4aab-a0db-78bc33e39b9f service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:52.590489 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-22a53a86-75b6-409c-a513-2b3e3b9838af req-12184697-1aab-4aab-a0db-78bc33e39b9f service nova] Creating event network-vif-deleted:9da24b37-2570-4ec8-b96e-7dd6c39379fc for instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 on hv-cinder-84131 May 10 20:00:52.595704 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-22a53a86-75b6-409c-a513-2b3e3b9838af req-12184697-1aab-4aab-a0db-78bc33e39b9f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 May 10 20:00:52.596844 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 200/416] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:00:52.827623 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5599f729-54cc-46a4-82d6-cd0bcb8809b2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Action: 'create', calling method: .version_select at 0x7fdd393331f0>, body: {"keypair": {"name": "tempest-keypair-1870975812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPiWk0FPXXqzkm7IChLGGNSSycjIa7BNE2AOAbZYuGT//Mun+GvJmqBi/N1XYKqF9Xcmu+gY1JeEjKESxcC53MJFrdItbjSQsmRvO0oh0Suoh4cmtguwwSwiYKqjKuxrg=="}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:52.841658 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-5599f729-54cc-46a4-82d6-cd0bcb8809b2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Getting quotas for project bfb1f4857a6e438e87e546dfd1d8a8b9. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:00:52.845999 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-5599f729-54cc-46a4-82d6-cd0bcb8809b2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Getting quotas for user 0b7dead8216e4cd59eaa15ad8842e38a and project bfb1f4857a6e438e87e546dfd1d8a8b9. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:00:52.868612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5599f729-54cc-46a4-82d6-cd0bcb8809b2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044953 May 10 20:00:52.869791 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 217/417] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 20:00:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:53.412685 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d33b8c7d-e23f-42ab-bbd9-316dabe4467a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:53.413400 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d33b8c7d-e23f-42ab-bbd9-316dabe4467a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 2f925619-022d-4541-a8ac-0c1cfd41efc0] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:53.419776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d33b8c7d-e23f-42ab-bbd9-316dabe4467a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:53.420258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d33b8c7d-e23f-42ab-bbd9-316dabe4467a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:53.421081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d33b8c7d-e23f-42ab-bbd9-316dabe4467a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:53.421524 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d33b8c7d-e23f-42ab-bbd9-316dabe4467a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:53.437454 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-d33b8c7d-e23f-42ab-bbd9-316dabe4467a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] HTTP exception thrown: Instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 could not be found. May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d33b8c7d-e23f-42ab-bbd9-316dabe4467a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Request method failure captured: May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 HTTP/1.1 May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNo04E0Z0Ck85gi8rn8y1lQtBLANGa8h6SePA9luVr3Mh9vwJluzvEZNvMI4J7xpX1FRp5GiMBU2GE0ovFK2LKxd8V93dEh7e7NT9bHjPShmoKFOaY_REigD35dmE73SupGZSHiej8LKf3MbyU9YaRyRdl5a32kmQxXHM4GF-5KxyQ May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 866e5dd5364e4bd980ba03f1b76aac9d May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:00:53.439763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/866e5dd5364e4bd980ba03f1b76aac9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_866e5dd5364e4bd980ba03f1b76aac9d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/866e5dd5364e4bd980ba03f1b76aac9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/866e5dd5364e4bd980ba03f1b76aac9d"}]}] May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 866e5dd5364e4bd980ba03f1b76aac9d May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-ServerRescueNegativeTestJSON-900477838-project May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: b642ac529ee043fd894a9188f30ed026 May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-900477838-project May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 could not be found. May 10 20:00:53.441071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '2f925619-022d-4541-a8ac-0c1cfd41efc0'} May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 could not be found. May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:00:53.441837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 could not be found. May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 could not be found. May 10 20:00:53.443063 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:00:53.445294 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d33b8c7d-e23f-42ab-bbd9-316dabe4467a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Returning 404 to user: Instance 2f925619-022d-4541-a8ac-0c1cfd41efc0 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:00:53.445294 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d33b8c7d-e23f-42ab-bbd9-316dabe4467a tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0" status: 404 len: 111 microversion: 2.1 time: 0.032853 May 10 20:00:53.445294 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 201/418] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:53 2022] GET /compute/v2.1/servers/2f925619-022d-4541-a8ac-0c1cfd41efc0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:00:53.451613 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1900bd2d-5e4a-4973-8291-e780c46532a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '.version_select at 0x7fdd391bd550>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:53.468456 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1900bd2d-5e4a-4973-8291-e780c46532a5 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-904504212" status: 202 len: 0 microversion: 2.1 time: 0.020658 May 10 20:00:53.469041 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 218/419] 10.222.0.57 () {58 vars in 1217 bytes} [Tue May 10 20:00:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-904504212 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:00:54.206130 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1163308760", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f696180f-7a91-4c53-a5b6-6312e26b7ddf"}], "security_groups": [{"name": "tempest-securitygroup--485362433"}], "key_name": "tempest-keypair-1870975812", "user_data": "}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:54.309397 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] validate_networks() for [('f696180f-7a91-4c53-a5b6-6312e26b7ddf', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:00:54.669532 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:00:54.669961 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:00:54.670442 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:00:54.670895 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:00:54.671312 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:00:54.680349 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:54.680804 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:54.681613 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:54.682059 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:54.698085 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Getting quotas for project bfb1f4857a6e438e87e546dfd1d8a8b9. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:00:54.701983 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Getting quotas for user 0b7dead8216e4cd59eaa15ad8842e38a and project bfb1f4857a6e438e87e546dfd1d8a8b9. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:00:54.713486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:00:54.715780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:00:54.760234 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d2f68ffc-98c6-4656-a6db-b0323743f71b tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.558449 May 10 20:00:54.760892 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 202/420] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:00:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:00:54.771867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-469abb87-8e10-4b56-9307-d0bba5604bf9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:54.772488 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-469abb87-8e10-4b56-9307-d0bba5604bf9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:54.824264 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-469abb87-8e10-4b56-9307-d0bba5604bf9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:54.831535 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-469abb87-8e10-4b56-9307-d0bba5604bf9 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1238 microversion: 2.1 time: 0.063926 May 10 20:00:54.832203 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 219/421] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:54 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:55.849375 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-29b91e87-8229-4cb4-8fa1-fb45098859d2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:55.849994 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-29b91e87-8229-4cb4-8fa1-fb45098859d2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:55.856776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29b91e87-8229-4cb4-8fa1-fb45098859d2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:55.857236 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29b91e87-8229-4cb4-8fa1-fb45098859d2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:55.858009 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29b91e87-8229-4cb4-8fa1-fb45098859d2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:55.858465 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29b91e87-8229-4cb4-8fa1-fb45098859d2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:55.960619 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-29b91e87-8229-4cb4-8fa1-fb45098859d2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:55.967875 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-29b91e87-8229-4cb4-8fa1-fb45098859d2 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1296 microversion: 2.1 time: 0.123346 May 10 20:00:55.968887 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 203/422] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:55 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1296 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:56.400287 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-549603e3-8aac-4af3-83d9-661a8f1719c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:56.401343 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-549603e3-8aac-4af3-83d9-661a8f1719c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:56.409898 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-549603e3-8aac-4af3-83d9-661a8f1719c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:56.410713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-549603e3-8aac-4af3-83d9-661a8f1719c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:56.411513 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-549603e3-8aac-4af3-83d9-661a8f1719c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:56.412144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-549603e3-8aac-4af3-83d9-661a8f1719c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:56.438807 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-549603e3-8aac-4af3-83d9-661a8f1719c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:00:56.533874 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-549603e3-8aac-4af3-83d9-661a8f1719c3 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "DELETE /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 204 len: 0 microversion: 2.1 time: 0.137136 May 10 20:00:56.537057 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 220/423] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:00:56 2022] DELETE /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:00:56.542715 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ec656065-221b-4eb1-bbdd-f2a3dfe33694 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:56.543336 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ec656065-221b-4eb1-bbdd-f2a3dfe33694 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:56.551702 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec656065-221b-4eb1-bbdd-f2a3dfe33694 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:56.552478 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec656065-221b-4eb1-bbdd-f2a3dfe33694 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:56.553131 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec656065-221b-4eb1-bbdd-f2a3dfe33694 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:56.553571 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec656065-221b-4eb1-bbdd-f2a3dfe33694 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:56.788804 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ec656065-221b-4eb1-bbdd-f2a3dfe33694 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:56.796076 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ec656065-221b-4eb1-bbdd-f2a3dfe33694 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1508 microversion: 2.1 time: 0.257197 May 10 20:00:56.796839 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 204/424] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:56 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:56.986370 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3ffdefd4-bd21-497e-acdc-e46f4b1b590d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:56.987132 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3ffdefd4-bd21-497e-acdc-e46f4b1b590d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:56.993491 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ffdefd4-bd21-497e-acdc-e46f4b1b590d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:56.994225 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ffdefd4-bd21-497e-acdc-e46f4b1b590d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:56.995031 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ffdefd4-bd21-497e-acdc-e46f4b1b590d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:56.995464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ffdefd4-bd21-497e-acdc-e46f4b1b590d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:57.135744 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3ffdefd4-bd21-497e-acdc-e46f4b1b590d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:57.143847 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3ffdefd4-bd21-497e-acdc-e46f4b1b590d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1363 microversion: 2.1 time: 0.162199 May 10 20:00:57.144440 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 221/425] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:56 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:57.176687 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-cd50c149-7c40-4da6-a14d-fbd2b9f41917 req-6cbe9c70-4dc8-47ea-9935-5c485100fcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad18001-e522-4e8a-b06a-36ddc62d01b6", "tag": "6d0c0b3f-2262-44f8-b7c0-664bc37d8eb8"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:00:57.185304 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-cd50c149-7c40-4da6-a14d-fbd2b9f41917 req-6cbe9c70-4dc8-47ea-9935-5c485100fcd0 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:57.186095 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-cd50c149-7c40-4da6-a14d-fbd2b9f41917 req-6cbe9c70-4dc8-47ea-9935-5c485100fcd0 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:57.199499 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-cd50c149-7c40-4da6-a14d-fbd2b9f41917 req-6cbe9c70-4dc8-47ea-9935-5c485100fcd0 service nova] Creating event network-changed:6d0c0b3f-2262-44f8-b7c0-664bc37d8eb8 for instance fad18001-e522-4e8a-b06a-36ddc62d01b6 on hv-cinder-84131 May 10 20:00:57.205043 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-cd50c149-7c40-4da6-a14d-fbd2b9f41917 req-6cbe9c70-4dc8-47ea-9935-5c485100fcd0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031940 May 10 20:00:57.206064 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 205/426] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:00:57.813607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1669f238-dc40-48ec-998d-719df30ee2e1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:57.814128 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1669f238-dc40-48ec-998d-719df30ee2e1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:57.820464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1669f238-dc40-48ec-998d-719df30ee2e1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:57.820915 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1669f238-dc40-48ec-998d-719df30ee2e1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:57.821687 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1669f238-dc40-48ec-998d-719df30ee2e1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:57.822099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1669f238-dc40-48ec-998d-719df30ee2e1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:57.950438 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1669f238-dc40-48ec-998d-719df30ee2e1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:57.957753 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1669f238-dc40-48ec-998d-719df30ee2e1 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1508 microversion: 2.1 time: 0.148695 May 10 20:00:57.958327 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 222/427] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:57 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:58.161592 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5401713b-7392-4619-9733-335cef9d3214 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:58.162208 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5401713b-7392-4619-9733-335cef9d3214 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:58.168379 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5401713b-7392-4619-9733-335cef9d3214 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:58.168840 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5401713b-7392-4619-9733-335cef9d3214 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:58.169600 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5401713b-7392-4619-9733-335cef9d3214 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:58.170036 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5401713b-7392-4619-9733-335cef9d3214 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:58.295173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5401713b-7392-4619-9733-335cef9d3214 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:58.303001 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5401713b-7392-4619-9733-335cef9d3214 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1363 microversion: 2.1 time: 0.146201 May 10 20:00:58.303573 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 206/428] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:58 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:58.974655 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e33581c8-11a3-4908-b22e-b824dee55b0f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:58.975280 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e33581c8-11a3-4908-b22e-b824dee55b0f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:58.981503 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e33581c8-11a3-4908-b22e-b824dee55b0f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:58.981965 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e33581c8-11a3-4908-b22e-b824dee55b0f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:58.982777 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e33581c8-11a3-4908-b22e-b824dee55b0f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:58.983225 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e33581c8-11a3-4908-b22e-b824dee55b0f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:59.110550 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e33581c8-11a3-4908-b22e-b824dee55b0f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:59.117792 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e33581c8-11a3-4908-b22e-b824dee55b0f tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1508 microversion: 2.1 time: 0.147038 May 10 20:00:59.118374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 223/429] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:58 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:59.320099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-909175e9-106e-47d1-bf8a-5a46fa5a03dd tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:59.320705 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-909175e9-106e-47d1-bf8a-5a46fa5a03dd tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:59.326963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-909175e9-106e-47d1-bf8a-5a46fa5a03dd tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:59.327421 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-909175e9-106e-47d1-bf8a-5a46fa5a03dd tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:59.328193 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-909175e9-106e-47d1-bf8a-5a46fa5a03dd tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:59.328681 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-909175e9-106e-47d1-bf8a-5a46fa5a03dd tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:59.679032 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-909175e9-106e-47d1-bf8a-5a46fa5a03dd tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:00:59.686447 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-909175e9-106e-47d1-bf8a-5a46fa5a03dd tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1363 microversion: 2.1 time: 0.370130 May 10 20:00:59.687041 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 207/430] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:00:59 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:00:59.761447 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3b4c4502-003b-49a7-bc7d-02cfb6e7778a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:00:59.761910 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3b4c4502-003b-49a7-bc7d-02cfb6e7778a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:00:59.769509 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b4c4502-003b-49a7-bc7d-02cfb6e7778a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:59.769969 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b4c4502-003b-49a7-bc7d-02cfb6e7778a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:59.770788 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b4c4502-003b-49a7-bc7d-02cfb6e7778a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:00:59.771223 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3b4c4502-003b-49a7-bc7d-02cfb6e7778a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:00:59.794314 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3b4c4502-003b-49a7-bc7d-02cfb6e7778a tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/ips" status: 200 len: 150 microversion: 2.1 time: 0.036813 May 10 20:00:59.794926 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 224/431] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 20:00:59 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:00.030477 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-4bde6ac2-ee14-41b2-98ea-4bc58930b21b req-adcfb23b-04b4-47a2-9d58-480e0a14aff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25288128-b7b5-43ff-917b-89fe72235bd5", "name": "network-vif-deleted", "tag": "3abf6ad5-d29b-44c9-be95-969586a18e23"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:00.040147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4bde6ac2-ee14-41b2-98ea-4bc58930b21b req-adcfb23b-04b4-47a2-9d58-480e0a14aff1 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:00.040593 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4bde6ac2-ee14-41b2-98ea-4bc58930b21b req-adcfb23b-04b4-47a2-9d58-480e0a14aff1 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:00.051822 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-4bde6ac2-ee14-41b2-98ea-4bc58930b21b req-adcfb23b-04b4-47a2-9d58-480e0a14aff1 service nova] Creating event network-vif-deleted:3abf6ad5-d29b-44c9-be95-969586a18e23 for instance 25288128-b7b5-43ff-917b-89fe72235bd5 on hv-cinder-84131 May 10 20:01:00.056714 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-4bde6ac2-ee14-41b2-98ea-4bc58930b21b req-adcfb23b-04b4-47a2-9d58-480e0a14aff1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029860 May 10 20:01:00.060777 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 208/432] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:00.137537 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-04d21a81-8768-4c06-8508-1c782c98eb53 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:00.138156 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-04d21a81-8768-4c06-8508-1c782c98eb53 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:00.145137 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04d21a81-8768-4c06-8508-1c782c98eb53 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:00.145594 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04d21a81-8768-4c06-8508-1c782c98eb53 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:00.146432 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04d21a81-8768-4c06-8508-1c782c98eb53 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:00.146873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04d21a81-8768-4c06-8508-1c782c98eb53 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:00.206874 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-04d21a81-8768-4c06-8508-1c782c98eb53 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:00.214034 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-04d21a81-8768-4c06-8508-1c782c98eb53 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1466 microversion: 2.1 time: 0.082273 May 10 20:01:00.214624 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 225/433] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:00 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1466 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:00.704137 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f2d72a93-03d8-4a24-b351-9c6a947213b5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:00.704845 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f2d72a93-03d8-4a24-b351-9c6a947213b5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:00.711240 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f2d72a93-03d8-4a24-b351-9c6a947213b5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:00.711693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f2d72a93-03d8-4a24-b351-9c6a947213b5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:00.712455 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f2d72a93-03d8-4a24-b351-9c6a947213b5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:00.712894 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f2d72a93-03d8-4a24-b351-9c6a947213b5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:00.842789 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f2d72a93-03d8-4a24-b351-9c6a947213b5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:00.850218 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f2d72a93-03d8-4a24-b351-9c6a947213b5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1363 microversion: 2.1 time: 0.151306 May 10 20:01:00.850866 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 209/434] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:00 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:01:01.139850 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8a65e070-c4be-49d2-b7fe-a3d6a416da85 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4c7a99b-858e-4e60-982a-896bce7e3780"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:01.140999 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8a65e070-c4be-49d2-b7fe-a3d6a416da85 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:01.147319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a65e070-c4be-49d2-b7fe-a3d6a416da85 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:01.147776 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a65e070-c4be-49d2-b7fe-a3d6a416da85 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:01.148554 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a65e070-c4be-49d2-b7fe-a3d6a416da85 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:01.149006 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a65e070-c4be-49d2-b7fe-a3d6a416da85 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:01.233137 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-71dce0e7-b9ba-49aa-b648-2d5cc01dd924 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:01.233763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-71dce0e7-b9ba-49aa-b648-2d5cc01dd924 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:01.240948 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-71dce0e7-b9ba-49aa-b648-2d5cc01dd924 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:01.241414 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-71dce0e7-b9ba-49aa-b648-2d5cc01dd924 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:01.243127 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-71dce0e7-b9ba-49aa-b648-2d5cc01dd924 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:01.243733 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-71dce0e7-b9ba-49aa-b648-2d5cc01dd924 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:01.278518 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-71dce0e7-b9ba-49aa-b648-2d5cc01dd924 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:01.279082 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-71dce0e7-b9ba-49aa-b648-2d5cc01dd924 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:01.279624 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-71dce0e7-b9ba-49aa-b648-2d5cc01dd924 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lazy-loading 'fault' on Instance uuid 25288128-b7b5-43ff-917b-89fe72235bd5 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:01:01.330631 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-71dce0e7-b9ba-49aa-b648-2d5cc01dd924 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:01.343305 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-71dce0e7-b9ba-49aa-b648-2d5cc01dd924 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 200 len: 1311 microversion: 2.1 time: 0.110530 May 10 20:01:01.344494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 210/435] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:01 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:01:01.397805 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8a65e070-c4be-49d2-b7fe-a3d6a416da85 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261719 May 10 20:01:01.398409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 226/436] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 20:01:01 2022] POST /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:01.866678 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5084ba16-5a66-4cd9-9778-25b8f9363c82 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:01.867344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5084ba16-5a66-4cd9-9778-25b8f9363c82 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:01.873907 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5084ba16-5a66-4cd9-9778-25b8f9363c82 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:01.874357 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5084ba16-5a66-4cd9-9778-25b8f9363c82 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:01.875664 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5084ba16-5a66-4cd9-9778-25b8f9363c82 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:01.876097 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5084ba16-5a66-4cd9-9778-25b8f9363c82 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:02.005250 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5084ba16-5a66-4cd9-9778-25b8f9363c82 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:02.012342 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5084ba16-5a66-4cd9-9778-25b8f9363c82 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1363 microversion: 2.1 time: 0.149801 May 10 20:01:02.012910 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 211/437] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:01 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:02.361998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0fb9c295-e69c-4770-a1cf-2f91cc76af2b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:02.362741 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0fb9c295-e69c-4770-a1cf-2f91cc76af2b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 25288128-b7b5-43ff-917b-89fe72235bd5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:02.369572 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0fb9c295-e69c-4770-a1cf-2f91cc76af2b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:02.370027 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0fb9c295-e69c-4770-a1cf-2f91cc76af2b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:02.370831 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0fb9c295-e69c-4770-a1cf-2f91cc76af2b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:02.371274 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0fb9c295-e69c-4770-a1cf-2f91cc76af2b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:02.384846 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-0fb9c295-e69c-4770-a1cf-2f91cc76af2b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] HTTP exception thrown: Instance 25288128-b7b5-43ff-917b-89fe72235bd5 could not be found. May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0fb9c295-e69c-4770-a1cf-2f91cc76af2b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Request method failure captured: May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 HTTP/1.1 May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNo04E0Z0Ck85gi8rn8y1lQtBLANGa8h6SePA9luVr3Mh9vwJluzvEZNvMI4J7xpX1FRp5GiMBU2GE0ovFK2LKxd8V93dEh7e7NT9bHjPShmoKFOaY_REigD35dmE73SupGZSHiej8LKf3MbyU9YaRyRdl5a32kmQxXHM4GF-5KxyQ May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 866e5dd5364e4bd980ba03f1b76aac9d May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:01:02.386446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/866e5dd5364e4bd980ba03f1b76aac9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_866e5dd5364e4bd980ba03f1b76aac9d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/866e5dd5364e4bd980ba03f1b76aac9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/866e5dd5364e4bd980ba03f1b76aac9d"}]}] May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 866e5dd5364e4bd980ba03f1b76aac9d May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-ServerRescueNegativeTestJSON-900477838-project May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: b642ac529ee043fd894a9188f30ed026 May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-900477838-project May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 25288128-b7b5-43ff-917b-89fe72235bd5 could not be found. May 10 20:01:02.387920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '25288128-b7b5-43ff-917b-89fe72235bd5'} May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25288128-b7b5-43ff-917b-89fe72235bd5 could not be found. May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:01:02.388767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25288128-b7b5-43ff-917b-89fe72235bd5 could not be found. May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25288128-b7b5-43ff-917b-89fe72235bd5 could not be found. May 10 20:01:02.389907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:01:02.391289 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0fb9c295-e69c-4770-a1cf-2f91cc76af2b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Returning 404 to user: Instance 25288128-b7b5-43ff-917b-89fe72235bd5 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:01:02.391289 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0fb9c295-e69c-4770-a1cf-2f91cc76af2b tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5" status: 404 len: 111 microversion: 2.1 time: 0.030647 May 10 20:01:02.391289 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 227/438] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:02 2022] GET /compute/v2.1/servers/25288128-b7b5-43ff-917b-89fe72235bd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:01:02.396293 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-352c50e1-d613-459a-8073-076e4cc0b009 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:02.396799 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-352c50e1-d613-459a-8073-076e4cc0b009 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:02.402728 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-352c50e1-d613-459a-8073-076e4cc0b009 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:02.403196 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-352c50e1-d613-459a-8073-076e4cc0b009 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:02.403972 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-352c50e1-d613-459a-8073-076e4cc0b009 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:02.404423 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-352c50e1-d613-459a-8073-076e4cc0b009 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:02.428800 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-352c50e1-d613-459a-8073-076e4cc0b009 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:01:02.512951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-352c50e1-d613-459a-8073-076e4cc0b009 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 204 len: 0 microversion: 2.1 time: 0.120244 May 10 20:01:02.516376 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 212/439] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:01:02 2022] DELETE /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:01:02.522806 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d1415f8f-406a-4f99-93f3-fe0f89fc6fad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:02.523094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d1415f8f-406a-4f99-93f3-fe0f89fc6fad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:02.530032 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1415f8f-406a-4f99-93f3-fe0f89fc6fad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:02.530575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1415f8f-406a-4f99-93f3-fe0f89fc6fad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:02.531940 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1415f8f-406a-4f99-93f3-fe0f89fc6fad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:02.532532 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1415f8f-406a-4f99-93f3-fe0f89fc6fad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:02.665275 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d1415f8f-406a-4f99-93f3-fe0f89fc6fad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:02.673115 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d1415f8f-406a-4f99-93f3-fe0f89fc6fad tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.154200 May 10 20:01:02.673673 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 228/440] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:02 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:03.030156 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e0f35e21-506f-4fcd-b98c-94c1b092bf8d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:03.030883 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e0f35e21-506f-4fcd-b98c-94c1b092bf8d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:03.037667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e0f35e21-506f-4fcd-b98c-94c1b092bf8d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:03.038121 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e0f35e21-506f-4fcd-b98c-94c1b092bf8d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:03.038913 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e0f35e21-506f-4fcd-b98c-94c1b092bf8d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:03.039351 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e0f35e21-506f-4fcd-b98c-94c1b092bf8d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:03.164209 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e0f35e21-506f-4fcd-b98c-94c1b092bf8d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:03.171378 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e0f35e21-506f-4fcd-b98c-94c1b092bf8d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1363 microversion: 2.1 time: 0.145391 May 10 20:01:03.171947 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 213/441] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:03 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:03.691704 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1781b3b9-cf7e-41bb-8504-c0d86e6fa5ec tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:03.692312 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1781b3b9-cf7e-41bb-8504-c0d86e6fa5ec tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:03.698633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1781b3b9-cf7e-41bb-8504-c0d86e6fa5ec tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:03.699111 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1781b3b9-cf7e-41bb-8504-c0d86e6fa5ec tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:03.699884 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1781b3b9-cf7e-41bb-8504-c0d86e6fa5ec tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:03.700327 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1781b3b9-cf7e-41bb-8504-c0d86e6fa5ec tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:03.824909 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1781b3b9-cf7e-41bb-8504-c0d86e6fa5ec tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:03.832729 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1781b3b9-cf7e-41bb-8504-c0d86e6fa5ec tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.145405 May 10 20:01:03.833307 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 229/442] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:03 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:04.189149 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9b8e4dd9-3723-4011-bd06-06cb8bec9387 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:04.189814 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9b8e4dd9-3723-4011-bd06-06cb8bec9387 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:04.196223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9b8e4dd9-3723-4011-bd06-06cb8bec9387 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:04.196656 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9b8e4dd9-3723-4011-bd06-06cb8bec9387 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:04.197478 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9b8e4dd9-3723-4011-bd06-06cb8bec9387 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:04.197913 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9b8e4dd9-3723-4011-bd06-06cb8bec9387 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:04.199340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-a9ad49ea-c571-4d40-a60e-72fe1216e0ec req-e8412a0c-c8f4-481f-92a3-0bf912c5af51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad18001-e522-4e8a-b06a-36ddc62d01b6", "name": "network-vif-plugged", "status": "completed", "tag": "6d0c0b3f-2262-44f8-b7c0-664bc37d8eb8"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:04.208364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-a9ad49ea-c571-4d40-a60e-72fe1216e0ec req-e8412a0c-c8f4-481f-92a3-0bf912c5af51 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:04.208968 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-a9ad49ea-c571-4d40-a60e-72fe1216e0ec req-e8412a0c-c8f4-481f-92a3-0bf912c5af51 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:04.221143 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-a9ad49ea-c571-4d40-a60e-72fe1216e0ec req-e8412a0c-c8f4-481f-92a3-0bf912c5af51 service nova] Creating event network-vif-plugged:6d0c0b3f-2262-44f8-b7c0-664bc37d8eb8 for instance fad18001-e522-4e8a-b06a-36ddc62d01b6 on hv-cinder-84131 May 10 20:01:04.226133 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-a9ad49ea-c571-4d40-a60e-72fe1216e0ec req-e8412a0c-c8f4-481f-92a3-0bf912c5af51 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030706 May 10 20:01:04.226948 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 230/443] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:04.332005 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9b8e4dd9-3723-4011-bd06-06cb8bec9387 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:04.339180 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9b8e4dd9-3723-4011-bd06-06cb8bec9387 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1363 microversion: 2.1 time: 0.154995 May 10 20:01:04.339751 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 214/444] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:04 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:04.849780 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4a1f7b47-4ed8-444c-8fd2-1c0f9a4b3589 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:04.850408 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4a1f7b47-4ed8-444c-8fd2-1c0f9a4b3589 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:04.857028 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a1f7b47-4ed8-444c-8fd2-1c0f9a4b3589 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:04.857476 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a1f7b47-4ed8-444c-8fd2-1c0f9a4b3589 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:04.858234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a1f7b47-4ed8-444c-8fd2-1c0f9a4b3589 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:04.858700 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a1f7b47-4ed8-444c-8fd2-1c0f9a4b3589 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:04.985982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4a1f7b47-4ed8-444c-8fd2-1c0f9a4b3589 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:04.993285 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4a1f7b47-4ed8-444c-8fd2-1c0f9a4b3589 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.147959 May 10 20:01:04.994102 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 231/445] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:04 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:05.356531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-23d69085-1b20-4333-bcac-da1f24e3ef28 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:05.357069 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-23d69085-1b20-4333-bcac-da1f24e3ef28 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:05.364272 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-23d69085-1b20-4333-bcac-da1f24e3ef28 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:05.364735 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-23d69085-1b20-4333-bcac-da1f24e3ef28 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:05.365517 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-23d69085-1b20-4333-bcac-da1f24e3ef28 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:05.365961 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-23d69085-1b20-4333-bcac-da1f24e3ef28 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:05.498892 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-23d69085-1b20-4333-bcac-da1f24e3ef28 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:05.506592 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-23d69085-1b20-4333-bcac-da1f24e3ef28 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1363 microversion: 2.1 time: 0.154055 May 10 20:01:05.507158 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 215/446] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:05 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:06.011254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-49ddb729-a978-48c9-a2bf-b92314539880 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:06.011858 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-49ddb729-a978-48c9-a2bf-b92314539880 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:06.018801 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49ddb729-a978-48c9-a2bf-b92314539880 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:06.019251 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49ddb729-a978-48c9-a2bf-b92314539880 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:06.020013 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49ddb729-a978-48c9-a2bf-b92314539880 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:06.020443 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49ddb729-a978-48c9-a2bf-b92314539880 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:06.147142 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-49ddb729-a978-48c9-a2bf-b92314539880 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:06.154625 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-49ddb729-a978-48c9-a2bf-b92314539880 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1523 microversion: 2.1 time: 0.147510 May 10 20:01:06.155190 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 232/447] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:06 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:06.524191 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-492c40cf-6992-4a3a-8488-c2fdbef24036 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:06.525638 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-492c40cf-6992-4a3a-8488-c2fdbef24036 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:06.531784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-492c40cf-6992-4a3a-8488-c2fdbef24036 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:06.532246 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-492c40cf-6992-4a3a-8488-c2fdbef24036 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:06.533032 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-492c40cf-6992-4a3a-8488-c2fdbef24036 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:06.533506 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-492c40cf-6992-4a3a-8488-c2fdbef24036 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:06.728584 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-492c40cf-6992-4a3a-8488-c2fdbef24036 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:06.735834 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-492c40cf-6992-4a3a-8488-c2fdbef24036 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1363 microversion: 2.1 time: 0.215517 May 10 20:01:06.736410 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 216/448] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:06 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:06.887817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-62eefe38-bc8a-415f-9da2-072e58c60b1b req-f79314f0-4761-4338-aa0f-97fa3cc7a3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6962e593-72bc-41e9-a336-2e87d494085e", "name": "network-vif-deleted", "tag": "d9dd365a-a9a9-4924-b77a-0eef389d3972"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:06.896555 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-62eefe38-bc8a-415f-9da2-072e58c60b1b req-f79314f0-4761-4338-aa0f-97fa3cc7a3fc service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:06.896995 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-62eefe38-bc8a-415f-9da2-072e58c60b1b req-f79314f0-4761-4338-aa0f-97fa3cc7a3fc service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:06.907743 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-62eefe38-bc8a-415f-9da2-072e58c60b1b req-f79314f0-4761-4338-aa0f-97fa3cc7a3fc service nova] Creating event network-vif-deleted:d9dd365a-a9a9-4924-b77a-0eef389d3972 for instance 6962e593-72bc-41e9-a336-2e87d494085e on hv-cinder-84131 May 10 20:01:06.913453 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-62eefe38-bc8a-415f-9da2-072e58c60b1b req-f79314f0-4761-4338-aa0f-97fa3cc7a3fc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029133 May 10 20:01:06.914061 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 233/449] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:07.172320 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-352ad53a-dacf-4064-a686-4910cefed935 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:07.172968 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-352ad53a-dacf-4064-a686-4910cefed935 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:07.180222 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-352ad53a-dacf-4064-a686-4910cefed935 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:07.180686 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-352ad53a-dacf-4064-a686-4910cefed935 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:07.181474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-352ad53a-dacf-4064-a686-4910cefed935 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:07.181918 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-352ad53a-dacf-4064-a686-4910cefed935 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:07.213499 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-352ad53a-dacf-4064-a686-4910cefed935 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:07.213955 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-352ad53a-dacf-4064-a686-4910cefed935 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:07.214637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-352ad53a-dacf-4064-a686-4910cefed935 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lazy-loading 'fault' on Instance uuid 6962e593-72bc-41e9-a336-2e87d494085e {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:01:07.256435 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-352ad53a-dacf-4064-a686-4910cefed935 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:07.264072 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-352ad53a-dacf-4064-a686-4910cefed935 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1312 microversion: 2.1 time: 0.095557 May 10 20:01:07.264663 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 217/450] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:07 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:07.754584 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d2d482a6-d963-49a2-818b-260ece2be6a8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:07.755286 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d2d482a6-d963-49a2-818b-260ece2be6a8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:07.761241 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2d482a6-d963-49a2-818b-260ece2be6a8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:07.761694 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2d482a6-d963-49a2-818b-260ece2be6a8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:07.762476 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2d482a6-d963-49a2-818b-260ece2be6a8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:07.762914 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2d482a6-d963-49a2-818b-260ece2be6a8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:07.889952 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d2d482a6-d963-49a2-818b-260ece2be6a8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:07.897841 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d2d482a6-d963-49a2-818b-260ece2be6a8 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1548 microversion: 2.1 time: 0.148496 May 10 20:01:07.898412 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 234/451] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:07 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:07.914157 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-20a382ee-6c9b-4c4d-8a65-be3ed5916154 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:07.914675 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-20a382ee-6c9b-4c4d-8a65-be3ed5916154 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:07.920953 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-20a382ee-6c9b-4c4d-8a65-be3ed5916154 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:07.921408 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-20a382ee-6c9b-4c4d-8a65-be3ed5916154 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:07.929622 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-20a382ee-6c9b-4c4d-8a65-be3ed5916154 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:07.930080 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-20a382ee-6c9b-4c4d-8a65-be3ed5916154 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:08.007346 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-20a382ee-6c9b-4c4d-8a65-be3ed5916154 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097102 May 10 20:01:08.008023 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 218/452] 10.222.0.57 () {58 vars in 1274 bytes} [Tue May 10 20:01:07 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:08.280439 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9acb5a02-02db-4b99-932a-c29daa886bd9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:08.281049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9acb5a02-02db-4b99-932a-c29daa886bd9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:08.287141 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9acb5a02-02db-4b99-932a-c29daa886bd9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:08.287596 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9acb5a02-02db-4b99-932a-c29daa886bd9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:08.288365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9acb5a02-02db-4b99-932a-c29daa886bd9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:08.288803 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9acb5a02-02db-4b99-932a-c29daa886bd9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:08.320232 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9acb5a02-02db-4b99-932a-c29daa886bd9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:08.320680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9acb5a02-02db-4b99-932a-c29daa886bd9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:08.321132 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-9acb5a02-02db-4b99-932a-c29daa886bd9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lazy-loading 'fault' on Instance uuid 6962e593-72bc-41e9-a336-2e87d494085e {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:01:08.363620 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9acb5a02-02db-4b99-932a-c29daa886bd9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b642ac529ee043fd894a9188f30ed026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '866e5dd5364e4bd980ba03f1b76aac9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:08.371330 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9acb5a02-02db-4b99-932a-c29daa886bd9 tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 200 len: 1312 microversion: 2.1 time: 0.094757 May 10 20:01:08.371904 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 235/453] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:08 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:08.880348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-227102a0-e214-48d8-b823-21b3367a254c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4c7a99b-858e-4e60-982a-896bce7e3780"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:08.881598 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-227102a0-e214-48d8-b823-21b3367a254c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:08.887492 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-227102a0-e214-48d8-b823-21b3367a254c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:08.888022 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-227102a0-e214-48d8-b823-21b3367a254c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:08.888872 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-227102a0-e214-48d8-b823-21b3367a254c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:08.889383 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-227102a0-e214-48d8-b823-21b3367a254c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:08.980044 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-227102a0-e214-48d8-b823-21b3367a254c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Invalid volume: volume f4c7a99b-858e-4e60-982a-896bce7e3780 is already attached to instances: 4e180d6e-d6c1-42af-9852-5048dde008df May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-227102a0-e214-48d8-b823-21b3367a254c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: POST /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-volume_attachments HTTP/1.1 May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 74 May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:01:08.981784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {"volumeAttachment": {"volumeId": "f4c7a99b-858e-4e60-982a-896bce7e3780"}} May 10 20:01:08.983322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Invalid volume: volume f4c7a99b-858e-4e60-982a-896bce7e3780 is already attached to instances: 4e180d6e-d6c1-42af-9852-5048dde008df May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'server_id': '4e180d6e-d6c1-42af-9852-5048dde008df', 'body': {'volumeAttachment': {'volumeId': 'f4c7a99b-858e-4e60-982a-896bce7e3780'}}} May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f4c7a99b-858e-4e60-982a-896bce7e3780 is already attached to instances: 4e180d6e-d6c1-42af-9852-5048dde008df May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:08.984165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f4c7a99b-858e-4e60-982a-896bce7e3780 is already attached to instances: 4e180d6e-d6c1-42af-9852-5048dde008df May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:08.985473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:01:08.987501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:01:08.987501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:01:08.987501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:01:08.987501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f4c7a99b-858e-4e60-982a-896bce7e3780 is already attached to instances: 4e180d6e-d6c1-42af-9852-5048dde008df May 10 20:01:08.987501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:08.987501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-227102a0-e214-48d8-b823-21b3367a254c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 400 to user: Invalid volume: volume f4c7a99b-858e-4e60-982a-896bce7e3780 is already attached to instances: 4e180d6e-d6c1-42af-9852-5048dde008df {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:01:08.987501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-227102a0-e214-48d8-b823-21b3367a254c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107664 May 10 20:01:08.987501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 219/454] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 20:01:08 2022] POST /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 20:01:08.989492 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-e6df665d-7248-4eef-89de-42221ec3a335 req-7d424a11-8909-4ac0-b41b-fb930854079c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad18001-e522-4e8a-b06a-36ddc62d01b6", "tag": "6d0c0b3f-2262-44f8-b7c0-664bc37d8eb8"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:09.002791 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-e6df665d-7248-4eef-89de-42221ec3a335 req-7d424a11-8909-4ac0-b41b-fb930854079c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:09.003408 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-e6df665d-7248-4eef-89de-42221ec3a335 req-7d424a11-8909-4ac0-b41b-fb930854079c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:09.014607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-e6df665d-7248-4eef-89de-42221ec3a335 req-7d424a11-8909-4ac0-b41b-fb930854079c service nova] Creating event network-changed:6d0c0b3f-2262-44f8-b7c0-664bc37d8eb8 for instance fad18001-e522-4e8a-b06a-36ddc62d01b6 on hv-cinder-84131 May 10 20:01:09.020110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-e6df665d-7248-4eef-89de-42221ec3a335 req-7d424a11-8909-4ac0-b41b-fb930854079c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039399 May 10 20:01:09.021499 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 236/455] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:01:09.047314 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5a0d6889-8894-451f-a71a-7865b0140785 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:09.047966 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5a0d6889-8894-451f-a71a-7865b0140785 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:09.057295 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a0d6889-8894-451f-a71a-7865b0140785 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:09.058040 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a0d6889-8894-451f-a71a-7865b0140785 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:09.059039 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a0d6889-8894-451f-a71a-7865b0140785 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:09.059670 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a0d6889-8894-451f-a71a-7865b0140785 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:09.149480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-5a0d6889-8894-451f-a71a-7865b0140785 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lazy-loading 'services' on Instance uuid 4e180d6e-d6c1-42af-9852-5048dde008df {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:01:09.231599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5a0d6889-8894-451f-a71a-7865b0140785 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-volume_attachments/f4c7a99b-858e-4e60-982a-896bce7e3780" status: 202 len: 0 microversion: 2.1 time: 0.187738 May 10 20:01:09.232545 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 220/456] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 20:01:09 2022] DELETE /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-volume_attachments/f4c7a99b-858e-4e60-982a-896bce7e3780 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:01:09.241568 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ae996165-1ca5-4d50-968a-f9ffb18698c8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:09.242620 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ae996165-1ca5-4d50-968a-f9ffb18698c8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:09.250965 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae996165-1ca5-4d50-968a-f9ffb18698c8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:09.251746 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae996165-1ca5-4d50-968a-f9ffb18698c8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:09.253241 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae996165-1ca5-4d50-968a-f9ffb18698c8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:09.253860 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae996165-1ca5-4d50-968a-f9ffb18698c8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:09.289437 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ae996165-1ca5-4d50-968a-f9ffb18698c8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052151 May 10 20:01:09.290647 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 237/457] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:01:09 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:01:09.389525 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2cd95550-2e88-48ac-b221-796c324e103d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:09.390416 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2cd95550-2e88-48ac-b221-796c324e103d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] [instance: 6962e593-72bc-41e9-a336-2e87d494085e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:09.397883 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cd95550-2e88-48ac-b221-796c324e103d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:09.398341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cd95550-2e88-48ac-b221-796c324e103d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:09.399160 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cd95550-2e88-48ac-b221-796c324e103d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:09.399600 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cd95550-2e88-48ac-b221-796c324e103d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:09.413697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-2cd95550-2e88-48ac-b221-796c324e103d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] HTTP exception thrown: Instance 6962e593-72bc-41e9-a336-2e87d494085e could not be found. May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2cd95550-2e88-48ac-b221-796c324e103d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Request method failure captured: May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e HTTP/1.1 May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNo04E0Z0Ck85gi8rn8y1lQtBLANGa8h6SePA9luVr3Mh9vwJluzvEZNvMI4J7xpX1FRp5GiMBU2GE0ovFK2LKxd8V93dEh7e7NT9bHjPShmoKFOaY_REigD35dmE73SupGZSHiej8LKf3MbyU9YaRyRdl5a32kmQxXHM4GF-5KxyQ May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 866e5dd5364e4bd980ba03f1b76aac9d May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:01:09.415453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/866e5dd5364e4bd980ba03f1b76aac9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_866e5dd5364e4bd980ba03f1b76aac9d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/866e5dd5364e4bd980ba03f1b76aac9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/866e5dd5364e4bd980ba03f1b76aac9d"}]}] May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 866e5dd5364e4bd980ba03f1b76aac9d May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-900477838 May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-ServerRescueNegativeTestJSON-900477838-project May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: b642ac529ee043fd894a9188f30ed026 May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-900477838-project May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 6962e593-72bc-41e9-a336-2e87d494085e could not be found. May 10 20:01:09.416734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '6962e593-72bc-41e9-a336-2e87d494085e'} May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6962e593-72bc-41e9-a336-2e87d494085e could not be found. May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:01:09.421341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6962e593-72bc-41e9-a336-2e87d494085e could not be found. May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6962e593-72bc-41e9-a336-2e87d494085e could not be found. May 10 20:01:09.423141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:09.424765 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2cd95550-2e88-48ac-b221-796c324e103d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] Returning 404 to user: Instance 6962e593-72bc-41e9-a336-2e87d494085e could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:01:09.424765 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2cd95550-2e88-48ac-b221-796c324e103d tempest-ServerRescueNegativeTestJSON-900477838 tempest-ServerRescueNegativeTestJSON-900477838-project] 10.222.0.57 "GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e" status: 404 len: 111 microversion: 2.1 time: 0.031690 May 10 20:01:09.424765 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 221/458] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:09 2022] GET /compute/v2.1/servers/6962e593-72bc-41e9-a336-2e87d494085e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:01:10.301969 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b4a59931-d41a-44a0-83be-9a6853a7fb9d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:10.302984 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b4a59931-d41a-44a0-83be-9a6853a7fb9d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:10.309193 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4a59931-d41a-44a0-83be-9a6853a7fb9d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:10.309652 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4a59931-d41a-44a0-83be-9a6853a7fb9d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:10.310428 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4a59931-d41a-44a0-83be-9a6853a7fb9d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:10.310898 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4a59931-d41a-44a0-83be-9a6853a7fb9d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:10.338482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b4a59931-d41a-44a0-83be-9a6853a7fb9d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041107 May 10 20:01:10.339081 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 238/459] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:01:10 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:01:10.395879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8c14d1c3-6a6e-4ec9-b030-ab2b9ddb1825 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:10.396392 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8c14d1c3-6a6e-4ec9-b030-ab2b9ddb1825 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:10.402663 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c14d1c3-6a6e-4ec9-b030-ab2b9ddb1825 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:10.403054 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c14d1c3-6a6e-4ec9-b030-ab2b9ddb1825 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:10.403817 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c14d1c3-6a6e-4ec9-b030-ab2b9ddb1825 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:10.404255 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c14d1c3-6a6e-4ec9-b030-ab2b9ddb1825 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:10.428951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8c14d1c3-6a6e-4ec9-b030-ab2b9ddb1825 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:01:10.516698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8c14d1c3-6a6e-4ec9-b030-ab2b9ddb1825 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 204 len: 0 microversion: 2.1 time: 0.124265 May 10 20:01:10.518309 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 222/460] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:01:10 2022] DELETE /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:01:10.528244 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a45b342d-affa-4b8b-9019-b7f1db680345 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:10.528814 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a45b342d-affa-4b8b-9019-b7f1db680345 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:10.535326 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a45b342d-affa-4b8b-9019-b7f1db680345 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:10.535782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a45b342d-affa-4b8b-9019-b7f1db680345 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:10.536556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a45b342d-affa-4b8b-9019-b7f1db680345 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:10.537122 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a45b342d-affa-4b8b-9019-b7f1db680345 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:10.765397 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a45b342d-affa-4b8b-9019-b7f1db680345 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:10.773466 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a45b342d-affa-4b8b-9019-b7f1db680345 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1682 microversion: 2.1 time: 0.249412 May 10 20:01:10.774048 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 239/461] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:10 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1682 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:11.791404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0cb3d9f4-2778-4f57-866b-9a2ff7724ea1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:11.792294 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0cb3d9f4-2778-4f57-866b-9a2ff7724ea1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:11.799287 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0cb3d9f4-2778-4f57-866b-9a2ff7724ea1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:11.799856 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0cb3d9f4-2778-4f57-866b-9a2ff7724ea1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:11.800836 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0cb3d9f4-2778-4f57-866b-9a2ff7724ea1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:11.801290 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0cb3d9f4-2778-4f57-866b-9a2ff7724ea1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:12.154286 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0cb3d9f4-2778-4f57-866b-9a2ff7724ea1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:12.162019 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0cb3d9f4-2778-4f57-866b-9a2ff7724ea1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1682 microversion: 2.1 time: 0.374924 May 10 20:01:12.162610 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 223/462] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:11 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1682 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:13.179961 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e2bdd8ce-e610-4d69-96be-4cadd7d47773 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:13.181100 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e2bdd8ce-e610-4d69-96be-4cadd7d47773 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:13.198961 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e2bdd8ce-e610-4d69-96be-4cadd7d47773 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:13.199415 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e2bdd8ce-e610-4d69-96be-4cadd7d47773 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:13.200197 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e2bdd8ce-e610-4d69-96be-4cadd7d47773 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:13.200630 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e2bdd8ce-e610-4d69-96be-4cadd7d47773 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:13.395720 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e2bdd8ce-e610-4d69-96be-4cadd7d47773 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:13.403655 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e2bdd8ce-e610-4d69-96be-4cadd7d47773 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 200 len: 1615 microversion: 2.1 time: 0.227893 May 10 20:01:13.413958 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 240/463] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:13 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 1615 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:13.441747 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-f3b03455-70db-4449-a91c-43b5099826c0 req-830c7b20-d1fd-4a33-957a-174aa48ef7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e180d6e-d6c1-42af-9852-5048dde008df", "name": "network-vif-deleted", "tag": "559a552a-a94f-4905-8ded-b87ae9722b5b"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:13.452124 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f3b03455-70db-4449-a91c-43b5099826c0 req-830c7b20-d1fd-4a33-957a-174aa48ef7f2 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:13.452763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f3b03455-70db-4449-a91c-43b5099826c0 req-830c7b20-d1fd-4a33-957a-174aa48ef7f2 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:13.465272 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-f3b03455-70db-4449-a91c-43b5099826c0 req-830c7b20-d1fd-4a33-957a-174aa48ef7f2 service nova] Creating event network-vif-deleted:559a552a-a94f-4905-8ded-b87ae9722b5b for instance 4e180d6e-d6c1-42af-9852-5048dde008df on hv-cinder-84131 May 10 20:01:13.471410 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-f3b03455-70db-4449-a91c-43b5099826c0 req-830c7b20-d1fd-4a33-957a-174aa48ef7f2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035711 May 10 20:01:13.472291 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 224/464] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:14.420799 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b4c23e6e-9ae9-4090-9520-ed169ee1bd8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:14.421838 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b4c23e6e-9ae9-4090-9520-ed169ee1bd8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:14.427912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4c23e6e-9ae9-4090-9520-ed169ee1bd8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:14.428495 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4c23e6e-9ae9-4090-9520-ed169ee1bd8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:14.429376 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4c23e6e-9ae9-4090-9520-ed169ee1bd8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:14.429982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4c23e6e-9ae9-4090-9520-ed169ee1bd8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:14.446318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-b4c23e6e-9ae9-4090-9520-ed169ee1bd8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b4c23e6e-9ae9-4090-9520-ed169ee1bd8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df HTTP/1.1 May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:01:14.449172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:01:14.450833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '4e180d6e-d6c1-42af-9852-5048dde008df'} May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:01:14.451737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:01:14.453107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:01:14.454330 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b4c23e6e-9ae9-4090-9520-ed169ee1bd8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:01:14.456198 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b4c23e6e-9ae9-4090-9520-ed169ee1bd8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 404 len: 111 microversion: 2.1 time: 0.039022 May 10 20:01:14.460108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 241/465] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:14 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:01:14.466215 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-308d5675-76e3-464d-8e8b-2de958ef71dd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '.version_select at 0x7fdd3a3a8310>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:14.486146 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-308d5675-76e3-464d-8e8b-2de958ef71dd tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600547393" status: 202 len: 0 microversion: 2.1 time: 0.024190 May 10 20:01:14.486922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 225/466] 10.222.0.57 () {58 vars in 1220 bytes} [Tue May 10 20:01:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600547393 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:01:15.180671 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-19badb79-4348-44f2-8832-69d14f04fbb1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: .version_select at 0x7fdd391d2820>, body: {"keypair": {"name": "tempest-keypair-353311215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyxrBL6NfLQMFtuAVQKS7/IGlckw5MZe5ROh3yrIZMlKEnXabGjC9MzqrDxyITWpTRkw71rTHxIa9Wt0/pkWmq3ecpMj7cxazl4qBZiyR4vXL4NM+SmvoIpR1YCkWszXw=="}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:15.195551 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-19badb79-4348-44f2-8832-69d14f04fbb1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for project 477a9d7174e544efbbe7803ca7e77521. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:01:15.199592 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-19badb79-4348-44f2-8832-69d14f04fbb1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for user 2751fce03c284a91b152f545bd8c63ce and project 477a9d7174e544efbbe7803ca7e77521. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:01:15.232549 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-19badb79-4348-44f2-8832-69d14f04fbb1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056564 May 10 20:01:15.233537 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 242/467] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 20:01:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:16.772518 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1862729335", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c69c6345-64af-49e8-8bf3-adcceaa64462"}], "security_groups": [{"name": "tempest-securitygroup--2066700516"}], "key_name": "tempest-keypair-353311215", "user_data": "}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:16.940622 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] validate_networks() for [('c69c6345-64af-49e8-8bf3-adcceaa64462', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:01:17.727190 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:01:17.727612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:01:17.728092 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:01:17.728495 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:01:17.728905 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:01:17.738111 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:17.738517 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:17.739317 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:17.739753 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:17.757051 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for project 477a9d7174e544efbbe7803ca7e77521. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:01:17.761645 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Getting quotas for user 2751fce03c284a91b152f545bd8c63ce and project 477a9d7174e544efbbe7803ca7e77521. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:01:17.773147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:01:17.775553 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:01:17.827399 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0b74158b-067f-48a6-9f19-583055bdc7ce tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.060728 May 10 20:01:17.828382 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 226/468] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:01:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:01:17.843568 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c4826243-37e3-442a-ad95-888165b73613 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:17.844850 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c4826243-37e3-442a-ad95-888165b73613 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:17.917540 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c4826243-37e3-442a-ad95-888165b73613 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:17.926879 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c4826243-37e3-442a-ad95-888165b73613 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1241 microversion: 2.1 time: 0.092439 May 10 20:01:17.927841 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 243/469] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:17 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:01:18.946648 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a200d956-bb36-4b39-a201-9c417b5bd40f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:18.956457 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a200d956-bb36-4b39-a201-9c417b5bd40f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:18.966333 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a200d956-bb36-4b39-a201-9c417b5bd40f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:18.967813 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a200d956-bb36-4b39-a201-9c417b5bd40f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:18.969859 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a200d956-bb36-4b39-a201-9c417b5bd40f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:18.970600 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a200d956-bb36-4b39-a201-9c417b5bd40f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:19.075124 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a200d956-bb36-4b39-a201-9c417b5bd40f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:19.084429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a200d956-bb36-4b39-a201-9c417b5bd40f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1293 microversion: 2.1 time: 0.143063 May 10 20:01:19.087703 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 227/470] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:18 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1293 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:19.675928 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-32acecec-dc42-4ed8-a026-1478ff71eb2b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Action: 'create', calling method: .version_select at 0x7fdd3920bee0>, body: {"keypair": {"name": "tempest-keypair-17528227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/OFk0d+2zhglYwDXJQgsQ1Vkz8SH5cEKRxiIUS0TfIlj9IfbmlSO0yHuWhsJyw67gtPjwci/yCDKroKXRsgU6BYE8Ff/xFatfmAIpfMi41CjYl9qSn6jztFZTQd4VBCg=="}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:19.701025 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-32acecec-dc42-4ed8-a026-1478ff71eb2b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Getting quotas for project 3f7d501f555c4a0ba2419f68ba756db7. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:01:19.706192 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-32acecec-dc42-4ed8-a026-1478ff71eb2b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Getting quotas for user 56653f5922984dde83b35ba154e97bd0 and project 3f7d501f555c4a0ba2419f68ba756db7. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:01:19.738127 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-32acecec-dc42-4ed8-a026-1478ff71eb2b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.201669 May 10 20:01:19.738787 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 244/471] 10.222.0.57 () {62 vars in 1199 bytes} [Tue May 10 20:01:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 20:01:20.105960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-95334866-cd15-48d2-9770-7af3ec641c32 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:20.106497 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-95334866-cd15-48d2-9770-7af3ec641c32 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:20.115544 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95334866-cd15-48d2-9770-7af3ec641c32 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:20.116228 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95334866-cd15-48d2-9770-7af3ec641c32 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:20.117260 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95334866-cd15-48d2-9770-7af3ec641c32 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:20.117936 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95334866-cd15-48d2-9770-7af3ec641c32 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:20.374294 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-95334866-cd15-48d2-9770-7af3ec641c32 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:20.387114 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-95334866-cd15-48d2-9770-7af3ec641c32 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1367 microversion: 2.1 time: 0.285814 May 10 20:01:20.388401 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 228/472] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:20 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:21.089894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-c05cb2f1-2549-4c38-91f1-0f33c3ea0299 req-ffc84b41-f862-4d15-9fa7-fc4f5dcbac85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "837a7763-9305-4f62-b70e-d633f834892f", "tag": "a4f6c88d-29e5-469b-8cef-1c56e40295d8"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:21.106108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-c05cb2f1-2549-4c38-91f1-0f33c3ea0299 req-ffc84b41-f862-4d15-9fa7-fc4f5dcbac85 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:21.106108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-c05cb2f1-2549-4c38-91f1-0f33c3ea0299 req-ffc84b41-f862-4d15-9fa7-fc4f5dcbac85 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:21.150136 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-c05cb2f1-2549-4c38-91f1-0f33c3ea0299 req-ffc84b41-f862-4d15-9fa7-fc4f5dcbac85 service nova] Creating event network-changed:a4f6c88d-29e5-469b-8cef-1c56e40295d8 for instance 837a7763-9305-4f62-b70e-d633f834892f on hv-cinder-84131 May 10 20:01:21.158568 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-615634621", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d96601e-070f-42ce-b6bb-05d8030298ee"}], "security_groups": [{"name": "tempest-securitygroup--1387039136"}], "key_name": "tempest-keypair-17528227", "user_data": "}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:21.165039 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-c05cb2f1-2549-4c38-91f1-0f33c3ea0299 req-ffc84b41-f862-4d15-9fa7-fc4f5dcbac85 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076976 May 10 20:01:21.169682 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 245/473] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:21.343984 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] validate_networks() for [('4d96601e-070f-42ce-b6bb-05d8030298ee', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:01:21.404448 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b3fa3ae1-7f0e-4acb-9ba8-2f82175fc4c2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:21.405157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b3fa3ae1-7f0e-4acb-9ba8-2f82175fc4c2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:21.411336 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3fa3ae1-7f0e-4acb-9ba8-2f82175fc4c2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:21.411794 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3fa3ae1-7f0e-4acb-9ba8-2f82175fc4c2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:21.412573 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3fa3ae1-7f0e-4acb-9ba8-2f82175fc4c2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:21.413014 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3fa3ae1-7f0e-4acb-9ba8-2f82175fc4c2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:21.578326 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b3fa3ae1-7f0e-4acb-9ba8-2f82175fc4c2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:21.588307 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b3fa3ae1-7f0e-4acb-9ba8-2f82175fc4c2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1367 microversion: 2.1 time: 0.187632 May 10 20:01:21.588895 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 246/474] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:21 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:01:21.955486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:01:21.955911 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:01:21.956382 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:01:21.956790 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:01:21.957198 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:01:21.967062 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:21.967522 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:21.968338 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:21.968780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:21.986772 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Getting quotas for project 3f7d501f555c4a0ba2419f68ba756db7. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:01:21.990683 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Getting quotas for user 56653f5922984dde83b35ba154e97bd0 and project 3f7d501f555c4a0ba2419f68ba756db7. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:01:22.002650 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:01:22.004807 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:01:22.050886 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7fff02b5-3f23-4ea4-bd96-5003b8e3f937 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.897743 May 10 20:01:22.051857 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 229/475] 10.222.0.57 () {62 vars in 1187 bytes} [Tue May 10 20:01:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 10 20:01:22.061663 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2d776eef-8356-4806-996b-e2527ed73280 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:22.062376 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2d776eef-8356-4806-996b-e2527ed73280 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:22.120565 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2d776eef-8356-4806-996b-e2527ed73280 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:22.128108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2d776eef-8356-4806-996b-e2527ed73280 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:22.129928 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2d776eef-8356-4806-996b-e2527ed73280 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:22.131081 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2d776eef-8356-4806-996b-e2527ed73280 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1279 microversion: 2.20 time: 0.073351 May 10 20:01:22.131682 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 247/476] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:01:22 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1279 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:01:22.665433 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fe8d9b27-3457-4873-aa57-95fc50bf63f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:22.666049 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fe8d9b27-3457-4873-aa57-95fc50bf63f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:22.672365 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe8d9b27-3457-4873-aa57-95fc50bf63f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:22.673015 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe8d9b27-3457-4873-aa57-95fc50bf63f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:22.673789 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe8d9b27-3457-4873-aa57-95fc50bf63f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:22.674222 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe8d9b27-3457-4873-aa57-95fc50bf63f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:22.913785 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fe8d9b27-3457-4873-aa57-95fc50bf63f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:22.922567 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fe8d9b27-3457-4873-aa57-95fc50bf63f1 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1367 microversion: 2.1 time: 0.320856 May 10 20:01:22.923409 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 230/477] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:22 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:23.153204 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-137d0950-4869-4c72-9d49-da758faf8f9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:23.153845 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-137d0950-4869-4c72-9d49-da758faf8f9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:23.161678 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-137d0950-4869-4c72-9d49-da758faf8f9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:23.162127 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-137d0950-4869-4c72-9d49-da758faf8f9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:23.162934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-137d0950-4869-4c72-9d49-da758faf8f9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:23.163368 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-137d0950-4869-4c72-9d49-da758faf8f9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:23.249320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-137d0950-4869-4c72-9d49-da758faf8f9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:23.261040 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-137d0950-4869-4c72-9d49-da758faf8f9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:23.265425 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-137d0950-4869-4c72-9d49-da758faf8f9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:23.266501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-137d0950-4869-4c72-9d49-da758faf8f9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1331 microversion: 2.20 time: 0.117194 May 10 20:01:23.270806 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 248/478] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:01:23 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:01:23.940088 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-572e3cae-bb0f-46a7-9644-4531b8d63242 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:23.941324 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-572e3cae-bb0f-46a7-9644-4531b8d63242 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:23.947903 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-572e3cae-bb0f-46a7-9644-4531b8d63242 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:23.948363 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-572e3cae-bb0f-46a7-9644-4531b8d63242 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:23.949135 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-572e3cae-bb0f-46a7-9644-4531b8d63242 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:23.949634 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-572e3cae-bb0f-46a7-9644-4531b8d63242 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:24.114426 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-572e3cae-bb0f-46a7-9644-4531b8d63242 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:24.121999 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-572e3cae-bb0f-46a7-9644-4531b8d63242 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1367 microversion: 2.1 time: 0.185749 May 10 20:01:24.122555 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 231/479] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:23 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:24.288754 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ec90414a-09d5-41c8-8992-ec8ca6502e70 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:24.290248 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ec90414a-09d5-41c8-8992-ec8ca6502e70 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:24.297408 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ec90414a-09d5-41c8-8992-ec8ca6502e70 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:24.298121 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ec90414a-09d5-41c8-8992-ec8ca6502e70 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:24.299085 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ec90414a-09d5-41c8-8992-ec8ca6502e70 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:24.299983 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ec90414a-09d5-41c8-8992-ec8ca6502e70 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:24.445551 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ec90414a-09d5-41c8-8992-ec8ca6502e70 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:24.453731 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ec90414a-09d5-41c8-8992-ec8ca6502e70 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:24.455291 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ec90414a-09d5-41c8-8992-ec8ca6502e70 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:24.457300 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ec90414a-09d5-41c8-8992-ec8ca6502e70 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1405 microversion: 2.20 time: 0.173662 May 10 20:01:24.458197 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 249/480] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:01:24 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:01:24.907639 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-f16834f5-becc-4225-aa4b-5331b9ccb6a4 req-41808830-a85e-4171-ac6e-4a45d37d9bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff53e635-0740-4f22-9c5b-8d8dd47571c5", "tag": "740fa7f3-ee5c-4744-9541-a814cc75f111"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:24.917944 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f16834f5-becc-4225-aa4b-5331b9ccb6a4 req-41808830-a85e-4171-ac6e-4a45d37d9bf3 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:24.918826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f16834f5-becc-4225-aa4b-5331b9ccb6a4 req-41808830-a85e-4171-ac6e-4a45d37d9bf3 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:24.943267 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-f16834f5-becc-4225-aa4b-5331b9ccb6a4 req-41808830-a85e-4171-ac6e-4a45d37d9bf3 service nova] Creating event network-changed:740fa7f3-ee5c-4744-9541-a814cc75f111 for instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 on hv-cinder-84131 May 10 20:01:24.949610 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-f16834f5-becc-4225-aa4b-5331b9ccb6a4 req-41808830-a85e-4171-ac6e-4a45d37d9bf3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054621 May 10 20:01:24.950231 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 232/481] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:25.139907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1ff63e64-cdad-4f40-b0db-e825547cb83b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:25.141026 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1ff63e64-cdad-4f40-b0db-e825547cb83b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:25.149289 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1ff63e64-cdad-4f40-b0db-e825547cb83b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:25.149775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1ff63e64-cdad-4f40-b0db-e825547cb83b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:25.150688 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1ff63e64-cdad-4f40-b0db-e825547cb83b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:25.151166 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1ff63e64-cdad-4f40-b0db-e825547cb83b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:25.280167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1ff63e64-cdad-4f40-b0db-e825547cb83b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:25.288634 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1ff63e64-cdad-4f40-b0db-e825547cb83b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1367 microversion: 2.1 time: 0.153193 May 10 20:01:25.289540 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 250/482] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:25 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:25.477353 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cda1ff41-5c04-4394-9695-24b2eaff3bc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:25.478081 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cda1ff41-5c04-4394-9695-24b2eaff3bc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:25.484232 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cda1ff41-5c04-4394-9695-24b2eaff3bc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:25.484699 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cda1ff41-5c04-4394-9695-24b2eaff3bc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:25.485468 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cda1ff41-5c04-4394-9695-24b2eaff3bc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:25.485909 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cda1ff41-5c04-4394-9695-24b2eaff3bc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:25.615037 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cda1ff41-5c04-4394-9695-24b2eaff3bc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:25.622961 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cda1ff41-5c04-4394-9695-24b2eaff3bc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:25.624475 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cda1ff41-5c04-4394-9695-24b2eaff3bc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:25.625593 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cda1ff41-5c04-4394-9695-24b2eaff3bc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1405 microversion: 2.20 time: 0.152672 May 10 20:01:25.626135 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 233/483] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:01:25 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:01:26.305303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a66c8b09-015a-4e7c-8b20-3021714e35f2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:26.306094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a66c8b09-015a-4e7c-8b20-3021714e35f2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:26.313371 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a66c8b09-015a-4e7c-8b20-3021714e35f2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:26.313907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a66c8b09-015a-4e7c-8b20-3021714e35f2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:26.314797 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a66c8b09-015a-4e7c-8b20-3021714e35f2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:26.315339 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a66c8b09-015a-4e7c-8b20-3021714e35f2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:26.451765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a66c8b09-015a-4e7c-8b20-3021714e35f2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:26.459945 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a66c8b09-015a-4e7c-8b20-3021714e35f2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1367 microversion: 2.1 time: 0.158288 May 10 20:01:26.469230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 251/484] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:26 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:26.469876 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-84a0eb97-6fe9-4c31-a917-786e55a404a5 req-be6580be-98db-490a-837c-3b62bc334545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837a7763-9305-4f62-b70e-d633f834892f", "name": "network-vif-plugged", "status": "completed", "tag": "a4f6c88d-29e5-469b-8cef-1c56e40295d8"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:26.479129 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-84a0eb97-6fe9-4c31-a917-786e55a404a5 req-be6580be-98db-490a-837c-3b62bc334545 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:26.479573 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-84a0eb97-6fe9-4c31-a917-786e55a404a5 req-be6580be-98db-490a-837c-3b62bc334545 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:26.490913 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-84a0eb97-6fe9-4c31-a917-786e55a404a5 req-be6580be-98db-490a-837c-3b62bc334545 service nova] Creating event network-vif-plugged:a4f6c88d-29e5-469b-8cef-1c56e40295d8 for instance 837a7763-9305-4f62-b70e-d633f834892f on hv-cinder-84131 May 10 20:01:26.496147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-84a0eb97-6fe9-4c31-a917-786e55a404a5 req-be6580be-98db-490a-837c-3b62bc334545 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030150 May 10 20:01:26.496960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 234/485] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:01:26.644261 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-34ea34ca-5cc8-45ae-b9f5-3d6985e856cc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:26.644960 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-34ea34ca-5cc8-45ae-b9f5-3d6985e856cc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:26.651085 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34ea34ca-5cc8-45ae-b9f5-3d6985e856cc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:26.651777 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34ea34ca-5cc8-45ae-b9f5-3d6985e856cc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:26.652617 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34ea34ca-5cc8-45ae-b9f5-3d6985e856cc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:26.653064 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34ea34ca-5cc8-45ae-b9f5-3d6985e856cc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:26.784342 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-34ea34ca-5cc8-45ae-b9f5-3d6985e856cc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:26.792682 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-34ea34ca-5cc8-45ae-b9f5-3d6985e856cc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:26.794416 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-34ea34ca-5cc8-45ae-b9f5-3d6985e856cc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:26.795974 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-34ea34ca-5cc8-45ae-b9f5-3d6985e856cc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1405 microversion: 2.20 time: 0.156089 May 10 20:01:26.796666 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 252/486] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:01:26 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:01:27.477929 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d312a7ac-4cd6-49c6-8864-eb2e2b7bfe3e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:27.478667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d312a7ac-4cd6-49c6-8864-eb2e2b7bfe3e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:27.485211 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d312a7ac-4cd6-49c6-8864-eb2e2b7bfe3e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:27.485672 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d312a7ac-4cd6-49c6-8864-eb2e2b7bfe3e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:27.486491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d312a7ac-4cd6-49c6-8864-eb2e2b7bfe3e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:27.487553 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d312a7ac-4cd6-49c6-8864-eb2e2b7bfe3e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:27.614762 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d312a7ac-4cd6-49c6-8864-eb2e2b7bfe3e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:27.622108 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d312a7ac-4cd6-49c6-8864-eb2e2b7bfe3e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1367 microversion: 2.1 time: 0.148407 May 10 20:01:27.622713 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 235/487] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:27 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:27.814083 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-015f0d9a-5958-46ef-a680-f4eb316f8991 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:27.814749 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-015f0d9a-5958-46ef-a680-f4eb316f8991 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:27.821061 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-015f0d9a-5958-46ef-a680-f4eb316f8991 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:27.821511 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-015f0d9a-5958-46ef-a680-f4eb316f8991 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:27.822275 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-015f0d9a-5958-46ef-a680-f4eb316f8991 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:27.822740 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-015f0d9a-5958-46ef-a680-f4eb316f8991 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:27.951167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-015f0d9a-5958-46ef-a680-f4eb316f8991 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:27.959403 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-015f0d9a-5958-46ef-a680-f4eb316f8991 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:27.960930 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-015f0d9a-5958-46ef-a680-f4eb316f8991 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:27.962029 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-015f0d9a-5958-46ef-a680-f4eb316f8991 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1405 microversion: 2.20 time: 0.151990 May 10 20:01:27.962617 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 253/488] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:01:27 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:01:28.515125 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-7472b2d2-d68d-4f98-bd65-2d881afc2933 req-19fdd332-d234-4839-b25e-bf901077ceda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff53e635-0740-4f22-9c5b-8d8dd47571c5", "name": "network-vif-plugged", "status": "completed", "tag": "740fa7f3-ee5c-4744-9541-a814cc75f111"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:28.523609 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-7472b2d2-d68d-4f98-bd65-2d881afc2933 req-19fdd332-d234-4839-b25e-bf901077ceda service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:28.524062 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-7472b2d2-d68d-4f98-bd65-2d881afc2933 req-19fdd332-d234-4839-b25e-bf901077ceda service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:28.534785 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-7472b2d2-d68d-4f98-bd65-2d881afc2933 req-19fdd332-d234-4839-b25e-bf901077ceda service nova] Creating event network-vif-plugged:740fa7f3-ee5c-4744-9541-a814cc75f111 for instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 on hv-cinder-84131 May 10 20:01:28.539612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-7472b2d2-d68d-4f98-bd65-2d881afc2933 req-19fdd332-d234-4839-b25e-bf901077ceda service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028101 May 10 20:01:28.540269 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 236/489] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:28.639617 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-05688d25-8805-4281-b238-5d195f9141f7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:28.640230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-05688d25-8805-4281-b238-5d195f9141f7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:28.646111 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05688d25-8805-4281-b238-5d195f9141f7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:28.646688 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05688d25-8805-4281-b238-5d195f9141f7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:28.647478 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05688d25-8805-4281-b238-5d195f9141f7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:28.647892 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05688d25-8805-4281-b238-5d195f9141f7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:28.776890 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-05688d25-8805-4281-b238-5d195f9141f7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:28.784672 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-05688d25-8805-4281-b238-5d195f9141f7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1557 microversion: 2.1 time: 0.149549 May 10 20:01:28.785256 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 254/490] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:28 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:28.802160 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d22b9335-2f80-4060-a534-9214c1645b5e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:28.802767 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d22b9335-2f80-4060-a534-9214c1645b5e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:28.808707 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d22b9335-2f80-4060-a534-9214c1645b5e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:28.809155 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d22b9335-2f80-4060-a534-9214c1645b5e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:28.809916 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d22b9335-2f80-4060-a534-9214c1645b5e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:28.810350 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d22b9335-2f80-4060-a534-9214c1645b5e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:28.885789 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d22b9335-2f80-4060-a534-9214c1645b5e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088451 May 10 20:01:28.886472 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 237/491] 10.222.0.57 () {58 vars in 1274 bytes} [Tue May 10 20:01:28 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:28.980510 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cce85fcb-db35-4c23-b8fe-f37ea6a909bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:28.981125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cce85fcb-db35-4c23-b8fe-f37ea6a909bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:28.987986 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cce85fcb-db35-4c23-b8fe-f37ea6a909bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:28.988440 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cce85fcb-db35-4c23-b8fe-f37ea6a909bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:28.989214 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cce85fcb-db35-4c23-b8fe-f37ea6a909bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:28.989656 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cce85fcb-db35-4c23-b8fe-f37ea6a909bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:29.120317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cce85fcb-db35-4c23-b8fe-f37ea6a909bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:29.128568 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cce85fcb-db35-4c23-b8fe-f37ea6a909bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:29.130088 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cce85fcb-db35-4c23-b8fe-f37ea6a909bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:29.131227 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cce85fcb-db35-4c23-b8fe-f37ea6a909bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1405 microversion: 2.20 time: 0.154615 May 10 20:01:29.131791 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 255/492] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:01:28 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:01:29.835083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-a4eeb4fe-722b-4f48-af1b-0aaa8dd9824f req-ed56fe25-ee42-4299-ba80-5815e526d35a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "837a7763-9305-4f62-b70e-d633f834892f", "tag": "a4f6c88d-29e5-469b-8cef-1c56e40295d8"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:29.843087 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-a4eeb4fe-722b-4f48-af1b-0aaa8dd9824f req-ed56fe25-ee42-4299-ba80-5815e526d35a service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:29.843605 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-a4eeb4fe-722b-4f48-af1b-0aaa8dd9824f req-ed56fe25-ee42-4299-ba80-5815e526d35a service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:29.854493 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-a4eeb4fe-722b-4f48-af1b-0aaa8dd9824f req-ed56fe25-ee42-4299-ba80-5815e526d35a service nova] Creating event network-changed:a4f6c88d-29e5-469b-8cef-1c56e40295d8 for instance 837a7763-9305-4f62-b70e-d633f834892f on hv-cinder-84131 May 10 20:01:29.859827 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-a4eeb4fe-722b-4f48-af1b-0aaa8dd9824f req-ed56fe25-ee42-4299-ba80-5815e526d35a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029231 May 10 20:01:29.860941 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 238/493] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:30.150140 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-363a8dcf-a293-464d-a96d-14cbf57469f5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:30.150906 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-363a8dcf-a293-464d-a96d-14cbf57469f5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:30.157445 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-363a8dcf-a293-464d-a96d-14cbf57469f5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:30.157938 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-363a8dcf-a293-464d-a96d-14cbf57469f5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:30.158755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-363a8dcf-a293-464d-a96d-14cbf57469f5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:30.159195 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-363a8dcf-a293-464d-a96d-14cbf57469f5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:30.289832 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-363a8dcf-a293-464d-a96d-14cbf57469f5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:30.298809 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-363a8dcf-a293-464d-a96d-14cbf57469f5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:30.300360 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-363a8dcf-a293-464d-a96d-14cbf57469f5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:30.301532 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-363a8dcf-a293-464d-a96d-14cbf57469f5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1405 microversion: 2.20 time: 0.155337 May 10 20:01:30.302747 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 256/494] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:01:30 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:01:31.321976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a2cd8397-8969-4d83-a3cc-3bdb7702d432 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:31.322716 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a2cd8397-8969-4d83-a3cc-3bdb7702d432 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:31.328754 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2cd8397-8969-4d83-a3cc-3bdb7702d432 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:31.329208 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2cd8397-8969-4d83-a3cc-3bdb7702d432 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:31.329969 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2cd8397-8969-4d83-a3cc-3bdb7702d432 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:31.330407 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2cd8397-8969-4d83-a3cc-3bdb7702d432 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:31.456225 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a2cd8397-8969-4d83-a3cc-3bdb7702d432 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:31.463942 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a2cd8397-8969-4d83-a3cc-3bdb7702d432 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:31.465465 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a2cd8397-8969-4d83-a3cc-3bdb7702d432 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:31.466655 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a2cd8397-8969-4d83-a3cc-3bdb7702d432 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1598 microversion: 2.20 time: 0.149697 May 10 20:01:31.467223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 239/495] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:01:31 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:01:31.483623 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-36f6c028-8777-4d18-b600-9753431f8895 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:31.484123 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-36f6c028-8777-4d18-b600-9753431f8895 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:31.490945 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-36f6c028-8777-4d18-b600-9753431f8895 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:31.491400 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-36f6c028-8777-4d18-b600-9753431f8895 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:31.492171 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-36f6c028-8777-4d18-b600-9753431f8895 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:31.492610 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-36f6c028-8777-4d18-b600-9753431f8895 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:31.567973 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-36f6c028-8777-4d18-b600-9753431f8895 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088114 May 10 20:01:31.568576 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 257/496] 10.222.0.57 () {60 vars in 1315 bytes} [Tue May 10 20:01:31 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:01:32.732273 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-bc2fc0bc-15bf-46e7-8f20-4538a88b3a37 req-f66a3b3c-91b9-45c5-b8c9-a0d712d52d4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff53e635-0740-4f22-9c5b-8d8dd47571c5", "tag": "740fa7f3-ee5c-4744-9541-a814cc75f111"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:32.740604 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-bc2fc0bc-15bf-46e7-8f20-4538a88b3a37 req-f66a3b3c-91b9-45c5-b8c9-a0d712d52d4d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:32.741055 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-bc2fc0bc-15bf-46e7-8f20-4538a88b3a37 req-f66a3b3c-91b9-45c5-b8c9-a0d712d52d4d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:32.751923 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-bc2fc0bc-15bf-46e7-8f20-4538a88b3a37 req-f66a3b3c-91b9-45c5-b8c9-a0d712d52d4d service nova] Creating event network-changed:740fa7f3-ee5c-4744-9541-a814cc75f111 for instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 on hv-cinder-84131 May 10 20:01:32.757481 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-bc2fc0bc-15bf-46e7-8f20-4538a88b3a37 req-f66a3b3c-91b9-45c5-b8c9-a0d712d52d4d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028783 May 10 20:01:32.758097 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 240/497] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:37.206053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:01:37.206579 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Tue May 10 20:01:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:01:39.159369 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b3611bfa-e82f-45b0-82c2-04f9ceb2663c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:39.160610 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b3611bfa-e82f-45b0-82c2-04f9ceb2663c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:39.167374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3611bfa-e82f-45b0-82c2-04f9ceb2663c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:39.167826 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3611bfa-e82f-45b0-82c2-04f9ceb2663c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:39.168677 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3611bfa-e82f-45b0-82c2-04f9ceb2663c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:39.169031 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3611bfa-e82f-45b0-82c2-04f9ceb2663c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:39.193976 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b3611bfa-e82f-45b0-82c2-04f9ceb2663c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:01:39.271806 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b3611bfa-e82f-45b0-82c2-04f9ceb2663c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "DELETE /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 204 len: 0 microversion: 2.1 time: 0.116419 May 10 20:01:39.272593 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 258/498] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:01:39 2022] DELETE /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:01:39.281439 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9aff2e55-727a-4698-b0fd-f582dc1e6b52 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:39.282135 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9aff2e55-727a-4698-b0fd-f582dc1e6b52 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:39.288334 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9aff2e55-727a-4698-b0fd-f582dc1e6b52 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:39.288781 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9aff2e55-727a-4698-b0fd-f582dc1e6b52 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:39.289535 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9aff2e55-727a-4698-b0fd-f582dc1e6b52 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:39.289968 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9aff2e55-727a-4698-b0fd-f582dc1e6b52 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:39.417023 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9aff2e55-727a-4698-b0fd-f582dc1e6b52 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:39.424354 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9aff2e55-727a-4698-b0fd-f582dc1e6b52 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1576 microversion: 2.1 time: 0.147465 May 10 20:01:39.424926 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 241/499] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:39 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:40.442266 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f10eb797-4e51-4fc4-a540-b5edc796d7a9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:40.443033 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f10eb797-4e51-4fc4-a540-b5edc796d7a9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:40.449232 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f10eb797-4e51-4fc4-a540-b5edc796d7a9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:40.449683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f10eb797-4e51-4fc4-a540-b5edc796d7a9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:40.450445 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f10eb797-4e51-4fc4-a540-b5edc796d7a9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:40.450909 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f10eb797-4e51-4fc4-a540-b5edc796d7a9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:40.582165 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f10eb797-4e51-4fc4-a540-b5edc796d7a9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:40.589440 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f10eb797-4e51-4fc4-a540-b5edc796d7a9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1576 microversion: 2.1 time: 0.151382 May 10 20:01:40.590003 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 259/500] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:40 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:41.606204 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-75120104-9527-4a92-aed5-4c802a0d485a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:41.606850 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-75120104-9527-4a92-aed5-4c802a0d485a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:41.614547 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-75120104-9527-4a92-aed5-4c802a0d485a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:41.615426 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-75120104-9527-4a92-aed5-4c802a0d485a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:41.616768 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-75120104-9527-4a92-aed5-4c802a0d485a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:41.617276 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-75120104-9527-4a92-aed5-4c802a0d485a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:41.689475 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-75120104-9527-4a92-aed5-4c802a0d485a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:41.696769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-75120104-9527-4a92-aed5-4c802a0d485a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 200 len: 1509 microversion: 2.1 time: 0.094558 May 10 20:01:41.697364 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 242/501] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:41 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 1509 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:41.864971 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-3bc5c828-f365-499d-a40b-cad0a1d5f9e7 req-eb39492d-6662-45e2-a5fe-6b52ae542468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e0633f-fa61-4d94-8b8b-663d1a59ed6f", "name": "network-vif-deleted", "tag": "d82adb7e-2a47-4a94-aa72-c7ea1f21f48c"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:41.874441 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-3bc5c828-f365-499d-a40b-cad0a1d5f9e7 req-eb39492d-6662-45e2-a5fe-6b52ae542468 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:41.875078 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-3bc5c828-f365-499d-a40b-cad0a1d5f9e7 req-eb39492d-6662-45e2-a5fe-6b52ae542468 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:41.886760 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-3bc5c828-f365-499d-a40b-cad0a1d5f9e7 req-eb39492d-6662-45e2-a5fe-6b52ae542468 service nova] Creating event network-vif-deleted:d82adb7e-2a47-4a94-aa72-c7ea1f21f48c for instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f on hv-cinder-84131 May 10 20:01:41.891914 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-3bc5c828-f365-499d-a40b-cad0a1d5f9e7 req-eb39492d-6662-45e2-a5fe-6b52ae542468 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030557 May 10 20:01:41.893060 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 260/502] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:42.713571 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-814593a6-092b-459c-aba3-504100a21fdd tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:42.714191 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-814593a6-092b-459c-aba3-504100a21fdd tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:42.720818 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-814593a6-092b-459c-aba3-504100a21fdd tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:42.721282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-814593a6-092b-459c-aba3-504100a21fdd tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:42.722037 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-814593a6-092b-459c-aba3-504100a21fdd tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:42.722485 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-814593a6-092b-459c-aba3-504100a21fdd tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:42.738841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-814593a6-092b-459c-aba3-504100a21fdd tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] HTTP exception thrown: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-814593a6-092b-459c-aba3-504100a21fdd tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Request method failure captured: May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f HTTP/1.1 May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesP7_wauQeN8SjuwdRP3sqBNlKqBu30ouXDPMYL9nQAUfxPGEihQnFdxB2AVzRhQWqtV0av6vdH4XOMNtOMXIs9uQxGZaz-2F9QC1BpAjHYL8wGwIA7xDNKJ2EBaju-u4OOiqxZK4Xz2GWvdpmbrB9QruDhXq-9slnILrQftaSqfvcM May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 493768250fbb449a8b5430992e76b60f May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-TestVolumeBootPattern-373508332 May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:01:42.740498 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/493768250fbb449a8b5430992e76b60f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_493768250fbb449a8b5430992e76b60f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/493768250fbb449a8b5430992e76b60f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/493768250fbb449a8b5430992e76b60f"}]}] May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-TestVolumeBootPattern-373508332 May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 493768250fbb449a8b5430992e76b60f May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-TestVolumeBootPattern-373508332 May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-TestVolumeBootPattern-373508332-project May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: be0ebfb74d254359b4dfa36d9aff4ac6 May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-TestVolumeBootPattern-373508332-project May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:01:42.742142 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '24e0633f-fa61-4d94-8b8b-663d1a59ed6f'} May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:01:42.743480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:01:42.745083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:01:42.746436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-814593a6-092b-459c-aba3-504100a21fdd tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Returning 404 to user: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:01:42.746436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-814593a6-092b-459c-aba3-504100a21fdd tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 404 len: 111 microversion: 2.1 time: 0.032337 May 10 20:01:42.746939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 243/503] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:42 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:01:42.840225 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1472885311", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-209518868", "security_groups": [{"name": "tempest-secgroup-smoke-470214062"}], "block_device_mapping_v2": [{"uuid": "cc764e4d-fbfb-4356-9075-785567f1bc91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d20c2327-06bd-4a9c-bc81-ab7a5e947390"}]}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:42.952612 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] validate_networks() for [('d20c2327-06bd-4a9c-bc81-ab7a5e947390', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:01:43.353223 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:01:43.353653 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:01:43.354165 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:01:43.354653 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:01:43.355069 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:01:43.363644 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:43.364127 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:43.364940 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:43.365378 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:43.381768 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Getting quotas for project 493768250fbb449a8b5430992e76b60f. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:01:43.385636 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Getting quotas for user be0ebfb74d254359b4dfa36d9aff4ac6 and project 493768250fbb449a8b5430992e76b60f. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:01:43.442232 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:01:43.444536 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc764e4d-fbfb-4356-9075-785567f1bc91',volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:01:43.566311 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cc0566d1-5a42-4725-9491-93d0d308fa66 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.730189 May 10 20:01:43.567007 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 261/504] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:01:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:01:43.577082 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5468ec45-c0d0-41ab-b673-91e7aed1d48b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:43.577709 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5468ec45-c0d0-41ab-b673-91e7aed1d48b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:43.629277 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5468ec45-c0d0-41ab-b673-91e7aed1d48b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:43.635704 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5468ec45-c0d0-41ab-b673-91e7aed1d48b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1094 microversion: 2.1 time: 0.062714 May 10 20:01:43.636277 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 244/505] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:43 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:44.653441 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d94178f1-0dc0-4a7f-8520-34b429ef511b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:44.654198 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d94178f1-0dc0-4a7f-8520-34b429ef511b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:44.661322 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d94178f1-0dc0-4a7f-8520-34b429ef511b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:44.661857 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d94178f1-0dc0-4a7f-8520-34b429ef511b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:44.662736 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d94178f1-0dc0-4a7f-8520-34b429ef511b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:44.663245 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d94178f1-0dc0-4a7f-8520-34b429ef511b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:44.729260 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d94178f1-0dc0-4a7f-8520-34b429ef511b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:44.736688 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d94178f1-0dc0-4a7f-8520-34b429ef511b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1210 microversion: 2.1 time: 0.087618 May 10 20:01:44.737355 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 262/506] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:44 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:45.281814 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d4542c8a-daa2-431e-8437-ed984ff9a4c5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:45.282315 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d4542c8a-daa2-431e-8437-ed984ff9a4c5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:45.289774 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d4542c8a-daa2-431e-8437-ed984ff9a4c5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:45.290262 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d4542c8a-daa2-431e-8437-ed984ff9a4c5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:45.291069 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d4542c8a-daa2-431e-8437-ed984ff9a4c5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:45.291512 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d4542c8a-daa2-431e-8437-ed984ff9a4c5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:45.314905 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d4542c8a-daa2-431e-8437-ed984ff9a4c5 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/ips" status: 200 len: 145 microversion: 2.1 time: 0.155380 May 10 20:01:45.316204 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 245/507] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 20:01:45 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/ips => generated 145 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:45.755273 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7dec80de-c847-4019-a36c-7890ac1c513e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:45.756056 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7dec80de-c847-4019-a36c-7890ac1c513e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:45.763804 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7dec80de-c847-4019-a36c-7890ac1c513e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:45.764566 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7dec80de-c847-4019-a36c-7890ac1c513e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:45.765585 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7dec80de-c847-4019-a36c-7890ac1c513e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:45.766104 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7dec80de-c847-4019-a36c-7890ac1c513e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:45.905391 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7dec80de-c847-4019-a36c-7890ac1c513e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:45.913832 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7dec80de-c847-4019-a36c-7890ac1c513e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.162873 May 10 20:01:45.914419 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 263/508] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:45 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:46.158356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-096ef921-2599-42d1-b917-0625a374c8ff req-e9a5d821-7a18-45b1-bd54-8b486ab64e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378c7384-2154-4589-a6f1-460252ad7fbb", "tag": "3861263d-5b70-4336-8929-4965baec17b5"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:46.168183 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-096ef921-2599-42d1-b917-0625a374c8ff req-e9a5d821-7a18-45b1-bd54-8b486ab64e5b service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:46.168629 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-096ef921-2599-42d1-b917-0625a374c8ff req-e9a5d821-7a18-45b1-bd54-8b486ab64e5b service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:46.181464 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-096ef921-2599-42d1-b917-0625a374c8ff req-e9a5d821-7a18-45b1-bd54-8b486ab64e5b service nova] Creating event network-changed:3861263d-5b70-4336-8929-4965baec17b5 for instance 378c7384-2154-4589-a6f1-460252ad7fbb on hv-cinder-84131 May 10 20:01:46.186747 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-096ef921-2599-42d1-b917-0625a374c8ff req-e9a5d821-7a18-45b1-bd54-8b486ab64e5b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098969 May 10 20:01:46.187352 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 246/509] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:01:46.651106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a2e04d31-c24e-478e-a059-03780ed7fd6a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1ccc073-7099-4c98-91cf-d374623998f0"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:46.652284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a2e04d31-c24e-478e-a059-03780ed7fd6a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:46.658141 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2e04d31-c24e-478e-a059-03780ed7fd6a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:46.658633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2e04d31-c24e-478e-a059-03780ed7fd6a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:46.660009 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2e04d31-c24e-478e-a059-03780ed7fd6a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:46.660469 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2e04d31-c24e-478e-a059-03780ed7fd6a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:46.905711 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a2e04d31-c24e-478e-a059-03780ed7fd6a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "POST /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258013 May 10 20:01:46.906890 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 264/510] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 20:01:46 2022] POST /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:46.933668 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3f029130-c919-4dcd-8e14-5005eb554663 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:46.935075 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3f029130-c919-4dcd-8e14-5005eb554663 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:46.941225 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f029130-c919-4dcd-8e14-5005eb554663 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:46.941677 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f029130-c919-4dcd-8e14-5005eb554663 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:46.943069 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f029130-c919-4dcd-8e14-5005eb554663 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:46.943506 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f029130-c919-4dcd-8e14-5005eb554663 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:47.152593 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3f029130-c919-4dcd-8e14-5005eb554663 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:47.160563 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3f029130-c919-4dcd-8e14-5005eb554663 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.234010 May 10 20:01:47.161223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 247/511] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:46 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:48.177901 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-63ee3d13-37e5-47ea-b62f-4aefa4762ef5 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:48.178634 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-63ee3d13-37e5-47ea-b62f-4aefa4762ef5 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:48.185122 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63ee3d13-37e5-47ea-b62f-4aefa4762ef5 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:48.185568 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63ee3d13-37e5-47ea-b62f-4aefa4762ef5 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:48.186617 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63ee3d13-37e5-47ea-b62f-4aefa4762ef5 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:48.187052 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63ee3d13-37e5-47ea-b62f-4aefa4762ef5 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:48.318394 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-63ee3d13-37e5-47ea-b62f-4aefa4762ef5 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:48.325646 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-63ee3d13-37e5-47ea-b62f-4aefa4762ef5 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.152165 May 10 20:01:48.326227 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 265/512] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:48 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:49.343014 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6e7bfaec-e6a0-473b-a236-26c6d33f971b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:49.343538 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6e7bfaec-e6a0-473b-a236-26c6d33f971b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:49.350639 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e7bfaec-e6a0-473b-a236-26c6d33f971b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:49.351090 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e7bfaec-e6a0-473b-a236-26c6d33f971b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:49.351849 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e7bfaec-e6a0-473b-a236-26c6d33f971b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:49.352281 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e7bfaec-e6a0-473b-a236-26c6d33f971b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:49.482335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6e7bfaec-e6a0-473b-a236-26c6d33f971b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:49.489620 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6e7bfaec-e6a0-473b-a236-26c6d33f971b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.150548 May 10 20:01:49.490184 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 248/513] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:49 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:50.506393 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f1a82552-cd37-4a41-b5bb-4175c37f02f8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:50.507050 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f1a82552-cd37-4a41-b5bb-4175c37f02f8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:50.513380 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1a82552-cd37-4a41-b5bb-4175c37f02f8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:50.513834 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1a82552-cd37-4a41-b5bb-4175c37f02f8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:50.514635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1a82552-cd37-4a41-b5bb-4175c37f02f8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:50.515079 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1a82552-cd37-4a41-b5bb-4175c37f02f8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:50.641277 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f1a82552-cd37-4a41-b5bb-4175c37f02f8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:50.649143 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f1a82552-cd37-4a41-b5bb-4175c37f02f8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.147076 May 10 20:01:50.649709 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 266/514] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:50 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:51.666186 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0d75a954-b680-4288-9cc1-3e34699ac6d6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:51.666845 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0d75a954-b680-4288-9cc1-3e34699ac6d6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:51.673126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0d75a954-b680-4288-9cc1-3e34699ac6d6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:51.673572 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0d75a954-b680-4288-9cc1-3e34699ac6d6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:51.674338 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0d75a954-b680-4288-9cc1-3e34699ac6d6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:51.674808 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0d75a954-b680-4288-9cc1-3e34699ac6d6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:51.800407 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0d75a954-b680-4288-9cc1-3e34699ac6d6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:51.807590 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0d75a954-b680-4288-9cc1-3e34699ac6d6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.145223 May 10 20:01:51.808164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 249/515] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:51 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:52.824247 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bc50a649-09e8-477c-92eb-54d0634dde8a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:52.824783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bc50a649-09e8-477c-92eb-54d0634dde8a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:52.831104 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc50a649-09e8-477c-92eb-54d0634dde8a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:52.831553 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc50a649-09e8-477c-92eb-54d0634dde8a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:52.832304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc50a649-09e8-477c-92eb-54d0634dde8a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:52.832737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc50a649-09e8-477c-92eb-54d0634dde8a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:52.961768 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bc50a649-09e8-477c-92eb-54d0634dde8a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:52.969030 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bc50a649-09e8-477c-92eb-54d0634dde8a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.148694 May 10 20:01:52.969591 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 267/516] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:52 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:53.986090 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-08b44573-9cd1-4a1b-9a08-725da9b9f67f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:53.986727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-08b44573-9cd1-4a1b-9a08-725da9b9f67f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:53.993309 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-08b44573-9cd1-4a1b-9a08-725da9b9f67f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:53.993759 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-08b44573-9cd1-4a1b-9a08-725da9b9f67f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:53.994546 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-08b44573-9cd1-4a1b-9a08-725da9b9f67f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:53.994991 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-08b44573-9cd1-4a1b-9a08-725da9b9f67f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:54.122730 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-08b44573-9cd1-4a1b-9a08-725da9b9f67f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:54.130400 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-08b44573-9cd1-4a1b-9a08-725da9b9f67f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.148130 May 10 20:01:54.130999 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 250/517] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:53 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:54.382065 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1a6dc5fe-8f27-426b-bc04-e1ab73979c67 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:54.383092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1a6dc5fe-8f27-426b-bc04-e1ab73979c67 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:54.389320 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a6dc5fe-8f27-426b-bc04-e1ab73979c67 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:54.389784 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a6dc5fe-8f27-426b-bc04-e1ab73979c67 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:54.390584 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a6dc5fe-8f27-426b-bc04-e1ab73979c67 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:54.391028 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a6dc5fe-8f27-426b-bc04-e1ab73979c67 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:54.419234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1a6dc5fe-8f27-426b-bc04-e1ab73979c67 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041566 May 10 20:01:54.419791 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 268/518] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:01:54 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:54.429255 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d5aeaf37-7caa-408a-ac80-e4dea45c9b05 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:54.429751 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d5aeaf37-7caa-408a-ac80-e4dea45c9b05 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:54.435567 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d5aeaf37-7caa-408a-ac80-e4dea45c9b05 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:54.436027 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d5aeaf37-7caa-408a-ac80-e4dea45c9b05 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:54.436801 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d5aeaf37-7caa-408a-ac80-e4dea45c9b05 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:54.437237 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d5aeaf37-7caa-408a-ac80-e4dea45c9b05 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:54.467202 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d5aeaf37-7caa-408a-ac80-e4dea45c9b05 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments/b1ccc073-7099-4c98-91cf-d374623998f0" status: 200 len: 194 microversion: 2.1 time: 0.041785 May 10 20:01:54.467882 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 251/519] 10.222.0.57 () {58 vars in 1412 bytes} [Tue May 10 20:01:54 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments/b1ccc073-7099-4c98-91cf-d374623998f0 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:55.147680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6fb1dba0-a5aa-4f09-8471-7b3a8965aa22 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:55.148301 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6fb1dba0-a5aa-4f09-8471-7b3a8965aa22 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:55.154192 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6fb1dba0-a5aa-4f09-8471-7b3a8965aa22 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:55.154700 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6fb1dba0-a5aa-4f09-8471-7b3a8965aa22 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:55.155471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6fb1dba0-a5aa-4f09-8471-7b3a8965aa22 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:55.155913 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6fb1dba0-a5aa-4f09-8471-7b3a8965aa22 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:55.282270 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6fb1dba0-a5aa-4f09-8471-7b3a8965aa22 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:55.289517 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6fb1dba0-a5aa-4f09-8471-7b3a8965aa22 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.146437 May 10 20:01:55.290096 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 269/520] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:55 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:55.772335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6e50ea79-c10e-4f11-909b-f4226c8827da tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2577fb1-ff27-49d0-98ee-988500d2282b"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:55.773482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6e50ea79-c10e-4f11-909b-f4226c8827da tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:55.779804 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e50ea79-c10e-4f11-909b-f4226c8827da tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:55.780201 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e50ea79-c10e-4f11-909b-f4226c8827da tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:55.780967 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e50ea79-c10e-4f11-909b-f4226c8827da tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:55.781409 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e50ea79-c10e-4f11-909b-f4226c8827da tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:56.011939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6e50ea79-c10e-4f11-909b-f4226c8827da tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "POST /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243731 May 10 20:01:56.016053 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 252/521] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 20:01:55 2022] POST /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:01:56.306258 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-349ea061-d87d-47af-8d3e-9084e8e9560b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:56.306856 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-349ea061-d87d-47af-8d3e-9084e8e9560b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:56.312961 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-349ea061-d87d-47af-8d3e-9084e8e9560b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:56.313405 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-349ea061-d87d-47af-8d3e-9084e8e9560b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:56.314163 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-349ea061-d87d-47af-8d3e-9084e8e9560b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:56.314616 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-349ea061-d87d-47af-8d3e-9084e8e9560b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:56.445926 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-349ea061-d87d-47af-8d3e-9084e8e9560b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:56.453812 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-349ea061-d87d-47af-8d3e-9084e8e9560b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.151374 May 10 20:01:56.463658 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 270/522] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:56 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:57.472041 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7b3a6ea2-3467-410c-8415-4d9f3c2c3087 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:57.472752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7b3a6ea2-3467-410c-8415-4d9f3c2c3087 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:57.479378 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b3a6ea2-3467-410c-8415-4d9f3c2c3087 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:57.479834 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b3a6ea2-3467-410c-8415-4d9f3c2c3087 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:57.480600 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b3a6ea2-3467-410c-8415-4d9f3c2c3087 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:57.481043 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b3a6ea2-3467-410c-8415-4d9f3c2c3087 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:57.609022 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7b3a6ea2-3467-410c-8415-4d9f3c2c3087 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:57.616229 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7b3a6ea2-3467-410c-8415-4d9f3c2c3087 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.148902 May 10 20:01:57.616799 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 253/523] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:57 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:58.434354 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-adf9b47b-bdd8-4903-8229-a4646563bef4 req-c6fae700-3cb9-481c-9a6b-485574faf642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378c7384-2154-4589-a6f1-460252ad7fbb", "name": "network-vif-plugged", "status": "completed", "tag": "3861263d-5b70-4336-8929-4965baec17b5"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:01:58.443054 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-adf9b47b-bdd8-4903-8229-a4646563bef4 req-c6fae700-3cb9-481c-9a6b-485574faf642 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:58.443511 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-adf9b47b-bdd8-4903-8229-a4646563bef4 req-c6fae700-3cb9-481c-9a6b-485574faf642 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:58.454401 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-adf9b47b-bdd8-4903-8229-a4646563bef4 req-c6fae700-3cb9-481c-9a6b-485574faf642 service nova] Creating event network-vif-plugged:3861263d-5b70-4336-8929-4965baec17b5 for instance 378c7384-2154-4589-a6f1-460252ad7fbb on hv-cinder-84131 May 10 20:01:58.459290 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-adf9b47b-bdd8-4903-8229-a4646563bef4 req-c6fae700-3cb9-481c-9a6b-485574faf642 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083641 May 10 20:01:58.459872 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 271/524] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:01:58.634979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7ded48c8-3f17-4158-9fe3-9e34e97d8c94 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:58.635530 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7ded48c8-3f17-4158-9fe3-9e34e97d8c94 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:58.643173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ded48c8-3f17-4158-9fe3-9e34e97d8c94 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:58.643634 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ded48c8-3f17-4158-9fe3-9e34e97d8c94 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:58.644416 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ded48c8-3f17-4158-9fe3-9e34e97d8c94 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:58.644861 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ded48c8-3f17-4158-9fe3-9e34e97d8c94 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:58.822268 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7ded48c8-3f17-4158-9fe3-9e34e97d8c94 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:58.829555 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7ded48c8-3f17-4158-9fe3-9e34e97d8c94 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.200284 May 10 20:01:58.830115 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 254/525] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:58 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:01:59.846192 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1203101f-c257-4b0b-a792-465c545f6266 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:01:59.846831 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1203101f-c257-4b0b-a792-465c545f6266 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:01:59.852879 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1203101f-c257-4b0b-a792-465c545f6266 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:59.853328 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1203101f-c257-4b0b-a792-465c545f6266 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:59.854087 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1203101f-c257-4b0b-a792-465c545f6266 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:01:59.854549 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1203101f-c257-4b0b-a792-465c545f6266 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:01:59.985052 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1203101f-c257-4b0b-a792-465c545f6266 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:01:59.993092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1203101f-c257-4b0b-a792-465c545f6266 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1265 microversion: 2.1 time: 0.151435 May 10 20:01:59.993650 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 272/526] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:01:59 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:02:01.009641 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d1e92694-2293-4b84-91cd-78f48213f7c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:01.010259 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d1e92694-2293-4b84-91cd-78f48213f7c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:01.017176 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1e92694-2293-4b84-91cd-78f48213f7c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:01.017634 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1e92694-2293-4b84-91cd-78f48213f7c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:01.018400 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1e92694-2293-4b84-91cd-78f48213f7c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:01.018868 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1e92694-2293-4b84-91cd-78f48213f7c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:01.146169 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d1e92694-2293-4b84-91cd-78f48213f7c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:01.153713 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d1e92694-2293-4b84-91cd-78f48213f7c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1453 microversion: 2.1 time: 0.147927 May 10 20:02:01.154294 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 255/527] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:01 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:02:01.169433 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-411fd973-85e9-4530-8883-fa1fb30fc202 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:01.170043 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-411fd973-85e9-4530-8883-fa1fb30fc202 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:01.176621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-411fd973-85e9-4530-8883-fa1fb30fc202 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:01.177078 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-411fd973-85e9-4530-8883-fa1fb30fc202 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:01.177837 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-411fd973-85e9-4530-8883-fa1fb30fc202 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:01.178271 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-411fd973-85e9-4530-8883-fa1fb30fc202 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:01.305464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-411fd973-85e9-4530-8883-fa1fb30fc202 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:01.312874 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-411fd973-85e9-4530-8883-fa1fb30fc202 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1453 microversion: 2.1 time: 0.147263 May 10 20:02:01.313440 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 273/528] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:01 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:02:02.906292 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-68eb517d-fd06-45e3-88ff-3275e1b19502 req-4bfb0ef0-6170-4468-a20b-6f2c5afc2e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378c7384-2154-4589-a6f1-460252ad7fbb", "tag": "3861263d-5b70-4336-8929-4965baec17b5"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:02:02.916724 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-68eb517d-fd06-45e3-88ff-3275e1b19502 req-4bfb0ef0-6170-4468-a20b-6f2c5afc2e32 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:02.917223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-68eb517d-fd06-45e3-88ff-3275e1b19502 req-4bfb0ef0-6170-4468-a20b-6f2c5afc2e32 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:02.928507 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-68eb517d-fd06-45e3-88ff-3275e1b19502 req-4bfb0ef0-6170-4468-a20b-6f2c5afc2e32 service nova] Creating event network-changed:3861263d-5b70-4336-8929-4965baec17b5 for instance 378c7384-2154-4589-a6f1-460252ad7fbb on hv-cinder-84131 May 10 20:02:02.933784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-68eb517d-fd06-45e3-88ff-3275e1b19502 req-4bfb0ef0-6170-4468-a20b-6f2c5afc2e32 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031168 May 10 20:02:02.934798 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 256/529] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:03.493277 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d65b52dc-dac4-414c-80bb-f3e37191cf64 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:03.494202 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d65b52dc-dac4-414c-80bb-f3e37191cf64 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:03.500580 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d65b52dc-dac4-414c-80bb-f3e37191cf64 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:03.501030 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d65b52dc-dac4-414c-80bb-f3e37191cf64 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:03.501801 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d65b52dc-dac4-414c-80bb-f3e37191cf64 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:03.502241 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d65b52dc-dac4-414c-80bb-f3e37191cf64 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:03.533089 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d65b52dc-dac4-414c-80bb-f3e37191cf64 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044547 May 10 20:02:03.533660 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 274/530] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:02:03 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:03.671613 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-43349fc4-773e-4157-955d-cf822455aa3d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:03.672195 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-43349fc4-773e-4157-955d-cf822455aa3d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:03.679918 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43349fc4-773e-4157-955d-cf822455aa3d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:03.680751 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43349fc4-773e-4157-955d-cf822455aa3d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:03.681701 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43349fc4-773e-4157-955d-cf822455aa3d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:03.682148 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43349fc4-773e-4157-955d-cf822455aa3d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:03.712719 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-43349fc4-773e-4157-955d-cf822455aa3d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments/b1ccc073-7099-4c98-91cf-d374623998f0" status: 200 len: 194 microversion: 2.1 time: 0.045345 May 10 20:02:03.713341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 257/531] 10.222.0.57 () {58 vars in 1412 bytes} [Tue May 10 20:02:03 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments/b1ccc073-7099-4c98-91cf-d374623998f0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:03.724019 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7e78bdfe-a44c-4970-8ab0-7d0925f2e71f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:03.724513 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7e78bdfe-a44c-4970-8ab0-7d0925f2e71f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:03.730531 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e78bdfe-a44c-4970-8ab0-7d0925f2e71f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:03.730984 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e78bdfe-a44c-4970-8ab0-7d0925f2e71f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:03.731754 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e78bdfe-a44c-4970-8ab0-7d0925f2e71f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:03.732191 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e78bdfe-a44c-4970-8ab0-7d0925f2e71f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:03.815442 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-7e78bdfe-a44c-4970-8ab0-7d0925f2e71f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lazy-loading 'services' on Instance uuid fad18001-e522-4e8a-b06a-36ddc62d01b6 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:02:03.886837 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7e78bdfe-a44c-4970-8ab0-7d0925f2e71f tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments/b1ccc073-7099-4c98-91cf-d374623998f0" status: 202 len: 0 microversion: 2.1 time: 0.167292 May 10 20:02:03.887443 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 275/532] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 20:02:03 2022] DELETE /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments/b1ccc073-7099-4c98-91cf-d374623998f0 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:02:04.999838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fa467421-6706-4472-a6e3-c5f5dfe4af8a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:05.000377 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fa467421-6706-4472-a6e3-c5f5dfe4af8a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:05.006517 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa467421-6706-4472-a6e3-c5f5dfe4af8a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:05.006971 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa467421-6706-4472-a6e3-c5f5dfe4af8a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:05.007729 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa467421-6706-4472-a6e3-c5f5dfe4af8a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:05.008162 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa467421-6706-4472-a6e3-c5f5dfe4af8a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:05.036566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fa467421-6706-4472-a6e3-c5f5dfe4af8a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments/c2577fb1-ff27-49d0-98ee-988500d2282b" status: 200 len: 194 microversion: 2.1 time: 0.040059 May 10 20:02:05.037137 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 258/533] 10.222.0.57 () {58 vars in 1412 bytes} [Tue May 10 20:02:04 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments/c2577fb1-ff27-49d0-98ee-988500d2282b => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:05.047140 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cc0aeb43-4e08-4f46-b060-bbb4122786e4 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:05.047721 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cc0aeb43-4e08-4f46-b060-bbb4122786e4 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:05.054451 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc0aeb43-4e08-4f46-b060-bbb4122786e4 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:05.054976 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc0aeb43-4e08-4f46-b060-bbb4122786e4 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:05.055756 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc0aeb43-4e08-4f46-b060-bbb4122786e4 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:05.056200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc0aeb43-4e08-4f46-b060-bbb4122786e4 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:05.133578 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-cc0aeb43-4e08-4f46-b060-bbb4122786e4 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lazy-loading 'services' on Instance uuid fad18001-e522-4e8a-b06a-36ddc62d01b6 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:02:05.203062 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cc0aeb43-4e08-4f46-b060-bbb4122786e4 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments/c2577fb1-ff27-49d0-98ee-988500d2282b" status: 202 len: 0 microversion: 2.1 time: 0.159918 May 10 20:02:05.203690 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 276/534] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 20:02:05 2022] DELETE /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments/c2577fb1-ff27-49d0-98ee-988500d2282b => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:02:06.364639 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a2a5d3a1-6c7d-48d0-a839-c0c82f44624a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:06.365566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a2a5d3a1-6c7d-48d0-a839-c0c82f44624a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:06.371973 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2a5d3a1-6c7d-48d0-a839-c0c82f44624a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:06.372421 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2a5d3a1-6c7d-48d0-a839-c0c82f44624a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:06.373172 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2a5d3a1-6c7d-48d0-a839-c0c82f44624a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:06.373605 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2a5d3a1-6c7d-48d0-a839-c0c82f44624a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:06.402056 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a2a5d3a1-6c7d-48d0-a839-c0c82f44624a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041999 May 10 20:02:06.402628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 259/535] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:02:06 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:02:06.503796 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-59d8dc8d-2e3d-48e3-9f2e-240bc5a28d2a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:06.504985 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-59d8dc8d-2e3d-48e3-9f2e-240bc5a28d2a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:06.511913 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59d8dc8d-2e3d-48e3-9f2e-240bc5a28d2a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:06.512032 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59d8dc8d-2e3d-48e3-9f2e-240bc5a28d2a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:06.512718 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59d8dc8d-2e3d-48e3-9f2e-240bc5a28d2a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:06.513159 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59d8dc8d-2e3d-48e3-9f2e-240bc5a28d2a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:06.542774 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-59d8dc8d-2e3d-48e3-9f2e-240bc5a28d2a tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043236 May 10 20:02:06.543344 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 277/536] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:02:06 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:02:06.597839 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c8ce505b-3737-4831-9531-87c7cf436a58 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:06.598950 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c8ce505b-3737-4831-9531-87c7cf436a58 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:06.604736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c8ce505b-3737-4831-9531-87c7cf436a58 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:06.605188 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c8ce505b-3737-4831-9531-87c7cf436a58 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:06.605950 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c8ce505b-3737-4831-9531-87c7cf436a58 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:06.606391 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c8ce505b-3737-4831-9531-87c7cf436a58 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:06.629924 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c8ce505b-3737-4831-9531-87c7cf436a58 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:02:06.708248 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c8ce505b-3737-4831-9531-87c7cf436a58 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 204 len: 0 microversion: 2.1 time: 0.113192 May 10 20:02:06.708960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 260/537] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:02:06 2022] DELETE /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:02:06.717332 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a33591d1-4baf-4186-bb6d-62c99904838d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:06.717937 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a33591d1-4baf-4186-bb6d-62c99904838d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:06.724422 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a33591d1-4baf-4186-bb6d-62c99904838d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:06.724870 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a33591d1-4baf-4186-bb6d-62c99904838d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:06.725628 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a33591d1-4baf-4186-bb6d-62c99904838d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:06.726061 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a33591d1-4baf-4186-bb6d-62c99904838d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:06.856936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a33591d1-4baf-4186-bb6d-62c99904838d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:06.864208 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a33591d1-4baf-4186-bb6d-62c99904838d tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1673 microversion: 2.1 time: 0.150687 May 10 20:02:06.864775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 278/538] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:06 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:02:07.881752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-debeb36f-d4fd-49ac-aa7c-def8d79a47b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:07.882370 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-debeb36f-d4fd-49ac-aa7c-def8d79a47b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:07.888779 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-debeb36f-d4fd-49ac-aa7c-def8d79a47b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:07.889499 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-debeb36f-d4fd-49ac-aa7c-def8d79a47b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:07.890271 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-debeb36f-d4fd-49ac-aa7c-def8d79a47b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:07.890733 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-debeb36f-d4fd-49ac-aa7c-def8d79a47b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:08.020778 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-debeb36f-d4fd-49ac-aa7c-def8d79a47b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:08.027993 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-debeb36f-d4fd-49ac-aa7c-def8d79a47b0 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1673 microversion: 2.1 time: 0.150542 May 10 20:02:08.028571 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 261/539] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:07 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:02:08.734579 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c0d3954f-4509-4e18-be51-4f3f69d0caaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:08.735109 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c0d3954f-4509-4e18-be51-4f3f69d0caaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:08.741923 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0d3954f-4509-4e18-be51-4f3f69d0caaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:08.742666 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0d3954f-4509-4e18-be51-4f3f69d0caaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:08.743433 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0d3954f-4509-4e18-be51-4f3f69d0caaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:08.743872 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0d3954f-4509-4e18-be51-4f3f69d0caaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:08.766645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c0d3954f-4509-4e18-be51-4f3f69d0caaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/ips" status: 200 len: 153 microversion: 2.20 time: 0.035999 May 10 20:02:08.767208 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 279/540] 10.222.0.57 () {60 vars in 1288 bytes} [Tue May 10 20:02:08 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:02:09.045301 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d0f06f6a-3d2f-4a74-a66d-4dbf0e6c449e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:09.046550 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d0f06f6a-3d2f-4a74-a66d-4dbf0e6c449e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:09.054936 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0f06f6a-3d2f-4a74-a66d-4dbf0e6c449e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:09.055455 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0f06f6a-3d2f-4a74-a66d-4dbf0e6c449e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:09.056296 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0f06f6a-3d2f-4a74-a66d-4dbf0e6c449e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:09.056957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0f06f6a-3d2f-4a74-a66d-4dbf0e6c449e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:09.290196 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d0f06f6a-3d2f-4a74-a66d-4dbf0e6c449e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7dead8216e4cd59eaa15ad8842e38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:09.297575 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d0f06f6a-3d2f-4a74-a66d-4dbf0e6c449e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 200 len: 1673 microversion: 2.1 time: 0.256377 May 10 20:02:09.298150 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 262/541] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:09 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 1673 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:02:09.738979 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-bd04e6a5-b88e-4463-9cd5-9c24cfd0e8f6 req-fe3b404e-7423-4b6d-a905-8f98b1ddbf7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad18001-e522-4e8a-b06a-36ddc62d01b6", "name": "network-vif-deleted", "tag": "6d0c0b3f-2262-44f8-b7c0-664bc37d8eb8"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:02:09.747549 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-bd04e6a5-b88e-4463-9cd5-9c24cfd0e8f6 req-fe3b404e-7423-4b6d-a905-8f98b1ddbf7e service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:09.748016 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-bd04e6a5-b88e-4463-9cd5-9c24cfd0e8f6 req-fe3b404e-7423-4b6d-a905-8f98b1ddbf7e service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:09.767329 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-bd04e6a5-b88e-4463-9cd5-9c24cfd0e8f6 req-fe3b404e-7423-4b6d-a905-8f98b1ddbf7e service nova] Creating event network-vif-deleted:6d0c0b3f-2262-44f8-b7c0-664bc37d8eb8 for instance fad18001-e522-4e8a-b06a-36ddc62d01b6 on hv-cinder-84131 May 10 20:02:09.772738 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-bd04e6a5-b88e-4463-9cd5-9c24cfd0e8f6 req-fe3b404e-7423-4b6d-a905-8f98b1ddbf7e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037450 May 10 20:02:09.773360 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 280/542] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:10.315411 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a13d46e7-53e5-4d8a-a7f3-187303544ee3 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:10.316032 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a13d46e7-53e5-4d8a-a7f3-187303544ee3 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:10.322908 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a13d46e7-53e5-4d8a-a7f3-187303544ee3 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:10.323368 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a13d46e7-53e5-4d8a-a7f3-187303544ee3 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:10.324150 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a13d46e7-53e5-4d8a-a7f3-187303544ee3 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:10.324594 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a13d46e7-53e5-4d8a-a7f3-187303544ee3 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:10.337919 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-a13d46e7-53e5-4d8a-a7f3-187303544ee3 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] HTTP exception thrown: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a13d46e7-53e5-4d8a-a7f3-187303544ee3 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Request method failure captured: May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 HTTP/1.1 May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNoatTMjL14OZuypFaXFv6yw-vdGHhlNY6cl9L2HKfC10hJs0GATwm31NDsRjpdi03jV5xt-0NHnBmVEY4o-X3FfWIc2xzPr7hpWu3AnhjpJV2fAHYmCNi9HNe2Ch8iOxAYm5C3DXH7eekXB83q49WbUVUIurPfDf0VeblppvIHg4s May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:02:10.339599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bfb1f4857a6e438e87e546dfd1d8a8b9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}] May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 0b7dead8216e4cd59eaa15ad8842e38a May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:10.341192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': 'fad18001-e522-4e8a-b06a-36ddc62d01b6'} May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:10.342066 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:10.343755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:10.345101 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a13d46e7-53e5-4d8a-a7f3-187303544ee3 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Returning 404 to user: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:10.345101 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a13d46e7-53e5-4d8a-a7f3-187303544ee3 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 404 len: 111 microversion: 2.1 time: 0.029460 May 10 20:02:10.345101 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 263/543] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:10 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:10.350789 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5a1b12cf-e9dd-4268-aebb-b174dd59de4e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '.version_select at 0x7fdd391c93a0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:10.368769 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5a1b12cf-e9dd-4268-aebb-b174dd59de4e tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870975812" status: 202 len: 0 microversion: 2.1 time: 0.022216 May 10 20:02:10.369473 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 281/544] 10.222.0.57 () {58 vars in 1220 bytes} [Tue May 10 20:02:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870975812 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:02:11.501231 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-926915e3-0473-4aff-a03d-eb39e666a1a3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:02:11.501905 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-926915e3-0473-4aff-a03d-eb39e666a1a3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:11.508372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-926915e3-0473-4aff-a03d-eb39e666a1a3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:11.508853 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-926915e3-0473-4aff-a03d-eb39e666a1a3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:11.509614 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-926915e3-0473-4aff-a03d-eb39e666a1a3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:11.510060 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-926915e3-0473-4aff-a03d-eb39e666a1a3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:11.533410 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-926915e3-0473-4aff-a03d-eb39e666a1a3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lazy-loading 'flavor' on Instance uuid ff53e635-0740-4f22-9c5b-8d8dd47571c5 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:02:11.806572 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-926915e3-0473-4aff-a03d-eb39e666a1a3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "POST /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/action" status: 202 len: 0 microversion: 2.20 time: 0.309245 May 10 20:02:11.807428 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 264/545] 10.222.0.57 () {62 vars in 1318 bytes} [Tue May 10 20:02:11 2022] POST /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:02:11.815870 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4a3d1b56-f3a7-4899-9baf-464b728fd2cf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:11.816609 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4a3d1b56-f3a7-4899-9baf-464b728fd2cf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:11.823034 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a3d1b56-f3a7-4899-9baf-464b728fd2cf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:11.823546 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a3d1b56-f3a7-4899-9baf-464b728fd2cf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:11.824345 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a3d1b56-f3a7-4899-9baf-464b728fd2cf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:11.824788 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a3d1b56-f3a7-4899-9baf-464b728fd2cf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:11.955498 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4a3d1b56-f3a7-4899-9baf-464b728fd2cf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:11.963623 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4a3d1b56-f3a7-4899-9baf-464b728fd2cf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:11.965122 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4a3d1b56-f3a7-4899-9baf-464b728fd2cf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:11.966297 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4a3d1b56-f3a7-4899-9baf-464b728fd2cf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.154797 May 10 20:02:11.966911 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 282/546] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:11 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:12.986260 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f08ee2d5-2bbb-4165-bc93-21f3b1805574 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:12.987010 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f08ee2d5-2bbb-4165-bc93-21f3b1805574 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:12.994060 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f08ee2d5-2bbb-4165-bc93-21f3b1805574 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:12.994525 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f08ee2d5-2bbb-4165-bc93-21f3b1805574 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:12.995287 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f08ee2d5-2bbb-4165-bc93-21f3b1805574 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:12.995716 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f08ee2d5-2bbb-4165-bc93-21f3b1805574 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:13.127473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f08ee2d5-2bbb-4165-bc93-21f3b1805574 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:13.137073 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f08ee2d5-2bbb-4165-bc93-21f3b1805574 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:13.138816 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f08ee2d5-2bbb-4165-bc93-21f3b1805574 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:13.139936 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f08ee2d5-2bbb-4165-bc93-21f3b1805574 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.158587 May 10 20:02:13.140494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 265/547] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:12 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:13.489155 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-da3cb19c-b808-4dff-993a-2162ad017992 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:13.489661 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-da3cb19c-b808-4dff-993a-2162ad017992 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:13.496421 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da3cb19c-b808-4dff-993a-2162ad017992 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:13.496897 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da3cb19c-b808-4dff-993a-2162ad017992 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:13.497680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da3cb19c-b808-4dff-993a-2162ad017992 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:13.498133 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da3cb19c-b808-4dff-993a-2162ad017992 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:13.511151 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-da3cb19c-b808-4dff-993a-2162ad017992 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] HTTP exception thrown: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-da3cb19c-b808-4dff-993a-2162ad017992 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Request method failure captured: May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: DELETE /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 HTTP/1.1 May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNoatTMjL14OZuypFaXFv6yw-vdGHhlNY6cl9L2HKfC10hJs0GATwm31NDsRjpdi03jV5xt-0NHnBmVEY4o-X3FfWIc2xzPr7hpWu3AnhjpJV2fAHYmCNi9HNe2Ch8iOxAYm5C3DXH7eekXB83q49WbUVUIurPfDf0VeblppvIHg4s May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:02:13.512793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bfb1f4857a6e438e87e546dfd1d8a8b9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}] May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 0b7dead8216e4cd59eaa15ad8842e38a May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:13.514338 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': 'fad18001-e522-4e8a-b06a-36ddc62d01b6'} May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:13.515110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:13.516250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:13.517512 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-da3cb19c-b808-4dff-993a-2162ad017992 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Returning 404 to user: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:13.517512 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-da3cb19c-b808-4dff-993a-2162ad017992 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 404 len: 111 microversion: 2.1 time: 0.028844 May 10 20:02:13.517512 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 283/548] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:02:13 2022] DELETE /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:13.526276 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e0d08393-47c2-401e-ae2a-b4410c70cf57 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:13.526451 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8d3b1f35-135c-4deb-ba7d-f265e2a81ac8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:13.526575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e0d08393-47c2-401e-ae2a-b4410c70cf57 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: fad18001-e522-4e8a-b06a-36ddc62d01b6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:13.526664 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8d3b1f35-135c-4deb-ba7d-f265e2a81ac8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:13.529765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e0d08393-47c2-401e-ae2a-b4410c70cf57 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:13.530177 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d3b1f35-135c-4deb-ba7d-f265e2a81ac8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:13.530287 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e0d08393-47c2-401e-ae2a-b4410c70cf57 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:13.530672 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d3b1f35-135c-4deb-ba7d-f265e2a81ac8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:13.531015 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e0d08393-47c2-401e-ae2a-b4410c70cf57 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:13.531457 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e0d08393-47c2-401e-ae2a-b4410c70cf57 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:13.531552 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d3b1f35-135c-4deb-ba7d-f265e2a81ac8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:13.532071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d3b1f35-135c-4deb-ba7d-f265e2a81ac8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:13.545515 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-e0d08393-47c2-401e-ae2a-b4410c70cf57 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] HTTP exception thrown: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e0d08393-47c2-401e-ae2a-b4410c70cf57 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Request method failure captured: May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 HTTP/1.1 May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNoatTMjL14OZuypFaXFv6yw-vdGHhlNY6cl9L2HKfC10hJs0GATwm31NDsRjpdi03jV5xt-0NHnBmVEY4o-X3FfWIc2xzPr7hpWu3AnhjpJV2fAHYmCNi9HNe2Ch8iOxAYm5C3DXH7eekXB83q49WbUVUIurPfDf0VeblppvIHg4s May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:02:13.547092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bfb1f4857a6e438e87e546dfd1d8a8b9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}] May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 0b7dead8216e4cd59eaa15ad8842e38a May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:13.548607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': 'fad18001-e522-4e8a-b06a-36ddc62d01b6'} May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:13.552561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. May 10 20:02:13.554331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:13.556355 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e0d08393-47c2-401e-ae2a-b4410c70cf57 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Returning 404 to user: Instance fad18001-e522-4e8a-b06a-36ddc62d01b6 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:13.556355 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e0d08393-47c2-401e-ae2a-b4410c70cf57 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6" status: 404 len: 111 microversion: 2.1 time: 0.029867 May 10 20:02:13.556355 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 284/549] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:13 2022] GET /compute/v2.1/servers/fad18001-e522-4e8a-b06a-36ddc62d01b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:02:13.558240 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8d3b1f35-135c-4deb-ba7d-f265e2a81ac8 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/ips" status: 200 len: 150 microversion: 2.1 time: 0.040392 May 10 20:02:13.559095 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 266/550] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 20:02:13 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:14.159134 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-daa1e7cd-b30b-4355-a752-bd90243b5ea4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:14.159747 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-daa1e7cd-b30b-4355-a752-bd90243b5ea4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:14.165668 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-daa1e7cd-b30b-4355-a752-bd90243b5ea4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:14.166126 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-daa1e7cd-b30b-4355-a752-bd90243b5ea4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:14.166927 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-daa1e7cd-b30b-4355-a752-bd90243b5ea4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:14.167369 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-daa1e7cd-b30b-4355-a752-bd90243b5ea4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:14.293627 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-daa1e7cd-b30b-4355-a752-bd90243b5ea4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:14.301365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-daa1e7cd-b30b-4355-a752-bd90243b5ea4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:14.303417 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-daa1e7cd-b30b-4355-a752-bd90243b5ea4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:14.304581 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-daa1e7cd-b30b-4355-a752-bd90243b5ea4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.149432 May 10 20:02:14.305148 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 285/551] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:14 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:14.681062 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-214ea614-0b04-4017-b12d-7e710c2f754c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:14.681559 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-214ea614-0b04-4017-b12d-7e710c2f754c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:14.687793 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-214ea614-0b04-4017-b12d-7e710c2f754c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:14.688249 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-214ea614-0b04-4017-b12d-7e710c2f754c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:14.689018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-214ea614-0b04-4017-b12d-7e710c2f754c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:14.689457 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-214ea614-0b04-4017-b12d-7e710c2f754c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:14.702355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-214ea614-0b04-4017-b12d-7e710c2f754c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] HTTP exception thrown: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-214ea614-0b04-4017-b12d-7e710c2f754c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Request method failure captured: May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: DELETE /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f HTTP/1.1 May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNoatTMjL14OZuypFaXFv6yw-vdGHhlNY6cl9L2HKfC10hJs0GATwm31NDsRjpdi03jV5xt-0NHnBmVEY4o-X3FfWIc2xzPr7hpWu3AnhjpJV2fAHYmCNi9HNe2Ch8iOxAYm5C3DXH7eekXB83q49WbUVUIurPfDf0VeblppvIHg4s May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:02:14.704016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bfb1f4857a6e438e87e546dfd1d8a8b9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}] May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 0b7dead8216e4cd59eaa15ad8842e38a May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:02:14.705534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': 'c1defef6-465d-4f6b-8217-bf739e977b8f'} May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:14.706540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:02:14.708474 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:14.709989 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-214ea614-0b04-4017-b12d-7e710c2f754c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Returning 404 to user: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:14.709989 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-214ea614-0b04-4017-b12d-7e710c2f754c tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 404 len: 111 microversion: 2.1 time: 0.028768 May 10 20:02:14.709989 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 267/552] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:02:14 2022] DELETE /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:14.714184 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-62fd431a-bac2-43df-a7fb-3c1b2e7a9b79 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:14.714829 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-62fd431a-bac2-43df-a7fb-3c1b2e7a9b79 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] [instance: c1defef6-465d-4f6b-8217-bf739e977b8f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:14.721202 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62fd431a-bac2-43df-a7fb-3c1b2e7a9b79 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:14.721654 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62fd431a-bac2-43df-a7fb-3c1b2e7a9b79 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:14.722418 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62fd431a-bac2-43df-a7fb-3c1b2e7a9b79 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:14.722888 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62fd431a-bac2-43df-a7fb-3c1b2e7a9b79 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:14.738194 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-62fd431a-bac2-43df-a7fb-3c1b2e7a9b79 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] HTTP exception thrown: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-62fd431a-bac2-43df-a7fb-3c1b2e7a9b79 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Request method failure captured: May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f HTTP/1.1 May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNoatTMjL14OZuypFaXFv6yw-vdGHhlNY6cl9L2HKfC10hJs0GATwm31NDsRjpdi03jV5xt-0NHnBmVEY4o-X3FfWIc2xzPr7hpWu3AnhjpJV2fAHYmCNi9HNe2Ch8iOxAYm5C3DXH7eekXB83q49WbUVUIurPfDf0VeblppvIHg4s May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:02:14.739767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bfb1f4857a6e438e87e546dfd1d8a8b9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bfb1f4857a6e438e87e546dfd1d8a8b9"}]}] May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: bfb1f4857a6e438e87e546dfd1d8a8b9 May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447019700 May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 0b7dead8216e4cd59eaa15ad8842e38a May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeTestJSON-1447019700-project May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:02:14.741262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': 'c1defef6-465d-4f6b-8217-bf739e977b8f'} May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:14.742519 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. May 10 20:02:14.743953 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:14.745314 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-62fd431a-bac2-43df-a7fb-3c1b2e7a9b79 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] Returning 404 to user: Instance c1defef6-465d-4f6b-8217-bf739e977b8f could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:14.745314 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-62fd431a-bac2-43df-a7fb-3c1b2e7a9b79 tempest-AttachVolumeTestJSON-1447019700 tempest-AttachVolumeTestJSON-1447019700-project] 10.222.0.57 "GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f" status: 404 len: 111 microversion: 2.1 time: 0.030799 May 10 20:02:14.745314 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 286/553] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:14 2022] GET /compute/v2.1/servers/c1defef6-465d-4f6b-8217-bf739e977b8f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:14.878327 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-609bff80-cc1c-4d93-84d7-f7c46ee6b48f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7241a543-be46-430c-97ef-b37024e1d4ec"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:02:14.879477 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-609bff80-cc1c-4d93-84d7-f7c46ee6b48f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:14.885430 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-609bff80-cc1c-4d93-84d7-f7c46ee6b48f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:14.885879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-609bff80-cc1c-4d93-84d7-f7c46ee6b48f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:14.886677 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-609bff80-cc1c-4d93-84d7-f7c46ee6b48f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:14.887118 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-609bff80-cc1c-4d93-84d7-f7c46ee6b48f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:15.133507 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-609bff80-cc1c-4d93-84d7-f7c46ee6b48f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "POST /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258845 May 10 20:02:15.134149 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 268/554] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 20:02:14 2022] POST /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:15.323208 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4f226b5b-1255-456b-971c-3fd11e7569ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:15.323825 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4f226b5b-1255-456b-971c-3fd11e7569ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:15.329644 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4f226b5b-1255-456b-971c-3fd11e7569ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:15.330101 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4f226b5b-1255-456b-971c-3fd11e7569ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:15.330906 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4f226b5b-1255-456b-971c-3fd11e7569ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:15.331381 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4f226b5b-1255-456b-971c-3fd11e7569ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:15.462529 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4f226b5b-1255-456b-971c-3fd11e7569ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:15.470695 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4f226b5b-1255-456b-971c-3fd11e7569ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:15.472220 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4f226b5b-1255-456b-971c-3fd11e7569ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:15.473427 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4f226b5b-1255-456b-971c-3fd11e7569ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.154214 May 10 20:02:15.474201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 287/555] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:15 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:16.494340 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3305854a-3533-4efe-97b3-0db6973a34ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:16.495458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3305854a-3533-4efe-97b3-0db6973a34ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:16.501682 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3305854a-3533-4efe-97b3-0db6973a34ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:16.502226 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3305854a-3533-4efe-97b3-0db6973a34ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:16.503119 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3305854a-3533-4efe-97b3-0db6973a34ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:16.503636 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3305854a-3533-4efe-97b3-0db6973a34ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:16.639484 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3305854a-3533-4efe-97b3-0db6973a34ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:16.648551 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3305854a-3533-4efe-97b3-0db6973a34ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:16.650064 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3305854a-3533-4efe-97b3-0db6973a34ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:16.651385 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3305854a-3533-4efe-97b3-0db6973a34ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.162285 May 10 20:02:16.651951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 269/556] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:16 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:17.669966 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c61b9d9b-fa96-42ac-acca-f353b602a756 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:17.670625 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c61b9d9b-fa96-42ac-acca-f353b602a756 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:17.677957 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c61b9d9b-fa96-42ac-acca-f353b602a756 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:17.678713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c61b9d9b-fa96-42ac-acca-f353b602a756 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:17.679508 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c61b9d9b-fa96-42ac-acca-f353b602a756 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:17.679952 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c61b9d9b-fa96-42ac-acca-f353b602a756 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:17.846126 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c61b9d9b-fa96-42ac-acca-f353b602a756 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:17.855008 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c61b9d9b-fa96-42ac-acca-f353b602a756 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:17.856945 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c61b9d9b-fa96-42ac-acca-f353b602a756 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:17.858298 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c61b9d9b-fa96-42ac-acca-f353b602a756 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.193112 May 10 20:02:17.858902 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 288/557] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:17 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:18.877042 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1f8dc400-7291-4ed1-98ef-bfb051b184fc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:18.877662 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1f8dc400-7291-4ed1-98ef-bfb051b184fc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:18.884241 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f8dc400-7291-4ed1-98ef-bfb051b184fc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:18.884698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f8dc400-7291-4ed1-98ef-bfb051b184fc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:18.885471 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f8dc400-7291-4ed1-98ef-bfb051b184fc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:18.885915 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f8dc400-7291-4ed1-98ef-bfb051b184fc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:19.015283 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1f8dc400-7291-4ed1-98ef-bfb051b184fc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:19.023041 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1f8dc400-7291-4ed1-98ef-bfb051b184fc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:19.024525 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1f8dc400-7291-4ed1-98ef-bfb051b184fc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:19.025673 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1f8dc400-7291-4ed1-98ef-bfb051b184fc tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.152815 May 10 20:02:19.026227 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 270/558] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:18 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:20.044256 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-eb3a53f3-875a-4a5b-b1e2-70b6e119ea45 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:20.044871 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-eb3a53f3-875a-4a5b-b1e2-70b6e119ea45 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:20.051215 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eb3a53f3-875a-4a5b-b1e2-70b6e119ea45 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:20.052182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eb3a53f3-875a-4a5b-b1e2-70b6e119ea45 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:20.052958 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eb3a53f3-875a-4a5b-b1e2-70b6e119ea45 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:20.053394 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eb3a53f3-875a-4a5b-b1e2-70b6e119ea45 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:20.179580 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-eb3a53f3-875a-4a5b-b1e2-70b6e119ea45 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:20.187262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-eb3a53f3-875a-4a5b-b1e2-70b6e119ea45 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:20.188767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-eb3a53f3-875a-4a5b-b1e2-70b6e119ea45 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:20.189914 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-eb3a53f3-875a-4a5b-b1e2-70b6e119ea45 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.149519 May 10 20:02:20.190493 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 289/559] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:20 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:21.209032 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-88a60376-05f6-4013-b360-1749fc8dac68 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:21.209892 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-88a60376-05f6-4013-b360-1749fc8dac68 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:21.217560 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-88a60376-05f6-4013-b360-1749fc8dac68 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:21.218018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-88a60376-05f6-4013-b360-1749fc8dac68 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:21.218830 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-88a60376-05f6-4013-b360-1749fc8dac68 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:21.219268 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-88a60376-05f6-4013-b360-1749fc8dac68 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:21.358640 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-88a60376-05f6-4013-b360-1749fc8dac68 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:21.370746 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-88a60376-05f6-4013-b360-1749fc8dac68 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:21.372633 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-88a60376-05f6-4013-b360-1749fc8dac68 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:21.375166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-88a60376-05f6-4013-b360-1749fc8dac68 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.170948 May 10 20:02:21.377487 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 271/560] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:21 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:22.395936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a793894e-e349-4583-8c7f-a97a66c49f21 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:22.396624 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a793894e-e349-4583-8c7f-a97a66c49f21 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:22.402996 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a793894e-e349-4583-8c7f-a97a66c49f21 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:22.403444 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a793894e-e349-4583-8c7f-a97a66c49f21 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:22.404209 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a793894e-e349-4583-8c7f-a97a66c49f21 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:22.404636 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a793894e-e349-4583-8c7f-a97a66c49f21 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:22.550104 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a793894e-e349-4583-8c7f-a97a66c49f21 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:22.558667 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a793894e-e349-4583-8c7f-a97a66c49f21 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:22.560280 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a793894e-e349-4583-8c7f-a97a66c49f21 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:22.561706 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a793894e-e349-4583-8c7f-a97a66c49f21 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1744 microversion: 2.20 time: 0.170232 May 10 20:02:22.562384 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 290/561] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:22 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:22.724397 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6aabf889-677c-4541-9288-d8cb501c0275 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:22.724989 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6aabf889-677c-4541-9288-d8cb501c0275 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:22.730890 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6aabf889-677c-4541-9288-d8cb501c0275 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:22.731441 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6aabf889-677c-4541-9288-d8cb501c0275 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:22.732125 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6aabf889-677c-4541-9288-d8cb501c0275 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:22.732565 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6aabf889-677c-4541-9288-d8cb501c0275 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:22.815769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-6aabf889-677c-4541-9288-d8cb501c0275 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lazy-loading 'services' on Instance uuid 837a7763-9305-4f62-b70e-d633f834892f {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:02:22.892325 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6aabf889-677c-4541-9288-d8cb501c0275 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments/7241a543-be46-430c-97ef-b37024e1d4ec" status: 202 len: 0 microversion: 2.1 time: 0.172067 May 10 20:02:22.893018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 272/562] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 20:02:22 2022] DELETE /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments/7241a543-be46-430c-97ef-b37024e1d4ec => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:02:22.905785 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d725d26f-65ce-49d0-b7d7-2a8bd1f950c7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:22.907444 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d725d26f-65ce-49d0-b7d7-2a8bd1f950c7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:22.919431 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d725d26f-65ce-49d0-b7d7-2a8bd1f950c7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:22.920432 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d725d26f-65ce-49d0-b7d7-2a8bd1f950c7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:22.921859 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d725d26f-65ce-49d0-b7d7-2a8bd1f950c7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:22.922842 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d725d26f-65ce-49d0-b7d7-2a8bd1f950c7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:22.963770 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d725d26f-65ce-49d0-b7d7-2a8bd1f950c7 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065213 May 10 20:02:22.964341 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 291/563] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:02:22 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:23.580862 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9823a573-36e3-40ec-bb38-aaa7ce2f0707 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:23.581587 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9823a573-36e3-40ec-bb38-aaa7ce2f0707 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:23.588335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9823a573-36e3-40ec-bb38-aaa7ce2f0707 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:23.588776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9823a573-36e3-40ec-bb38-aaa7ce2f0707 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:23.589531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9823a573-36e3-40ec-bb38-aaa7ce2f0707 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:23.589960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9823a573-36e3-40ec-bb38-aaa7ce2f0707 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:23.713272 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9823a573-36e3-40ec-bb38-aaa7ce2f0707 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:23.720929 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9823a573-36e3-40ec-bb38-aaa7ce2f0707 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:23.722438 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9823a573-36e3-40ec-bb38-aaa7ce2f0707 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:23.723618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9823a573-36e3-40ec-bb38-aaa7ce2f0707 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1744 microversion: 2.20 time: 0.147040 May 10 20:02:23.724184 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 273/564] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:23 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1744 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:23.976254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-54747b0c-3bf2-4191-b266-f8697ebcb016 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:23.977167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-54747b0c-3bf2-4191-b266-f8697ebcb016 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:23.983591 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-54747b0c-3bf2-4191-b266-f8697ebcb016 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:23.984041 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-54747b0c-3bf2-4191-b266-f8697ebcb016 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:23.984798 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-54747b0c-3bf2-4191-b266-f8697ebcb016 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:23.985228 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-54747b0c-3bf2-4191-b266-f8697ebcb016 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:24.012802 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-54747b0c-3bf2-4191-b266-f8697ebcb016 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041095 May 10 20:02:24.013346 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 292/565] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:02:23 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:24.741553 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-245aa6cd-14a5-4917-bf2a-226af7730032 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:24.742411 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-245aa6cd-14a5-4917-bf2a-226af7730032 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:24.748712 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-245aa6cd-14a5-4917-bf2a-226af7730032 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:24.749166 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-245aa6cd-14a5-4917-bf2a-226af7730032 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:24.749925 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-245aa6cd-14a5-4917-bf2a-226af7730032 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:24.750390 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-245aa6cd-14a5-4917-bf2a-226af7730032 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:24.875334 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-245aa6cd-14a5-4917-bf2a-226af7730032 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:24.883140 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-245aa6cd-14a5-4917-bf2a-226af7730032 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:24.884631 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-245aa6cd-14a5-4917-bf2a-226af7730032 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:24.885772 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-245aa6cd-14a5-4917-bf2a-226af7730032 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1744 microversion: 2.20 time: 0.148562 May 10 20:02:24.886321 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 274/566] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:24 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:25.023446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f54fbd0e-f366-4def-b643-0074bff9f0a9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:25.024358 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f54fbd0e-f366-4def-b643-0074bff9f0a9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:25.030707 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f54fbd0e-f366-4def-b643-0074bff9f0a9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:25.031154 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f54fbd0e-f366-4def-b643-0074bff9f0a9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:25.031910 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f54fbd0e-f366-4def-b643-0074bff9f0a9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:25.032344 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f54fbd0e-f366-4def-b643-0074bff9f0a9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:25.060912 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f54fbd0e-f366-4def-b643-0074bff9f0a9 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041448 May 10 20:02:25.061451 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 293/567] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:02:25 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:25.904061 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-358c88f7-5b2b-4fc7-84d7-cdd1778c469e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:25.904670 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-358c88f7-5b2b-4fc7-84d7-cdd1778c469e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:25.911263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-358c88f7-5b2b-4fc7-84d7-cdd1778c469e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:25.911725 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-358c88f7-5b2b-4fc7-84d7-cdd1778c469e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:25.912497 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-358c88f7-5b2b-4fc7-84d7-cdd1778c469e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:25.912941 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-358c88f7-5b2b-4fc7-84d7-cdd1778c469e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:26.039944 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-358c88f7-5b2b-4fc7-84d7-cdd1778c469e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:26.047571 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-358c88f7-5b2b-4fc7-84d7-cdd1778c469e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:26.049067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-358c88f7-5b2b-4fc7-84d7-cdd1778c469e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:26.050214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-358c88f7-5b2b-4fc7-84d7-cdd1778c469e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1744 microversion: 2.20 time: 0.150079 May 10 20:02:26.050810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 275/568] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:25 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:26.072952 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-82325395-d80b-4870-a6b4-ea5ae7baa52f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:26.073884 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-82325395-d80b-4870-a6b4-ea5ae7baa52f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:26.080191 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-82325395-d80b-4870-a6b4-ea5ae7baa52f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:26.080647 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-82325395-d80b-4870-a6b4-ea5ae7baa52f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:26.081416 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-82325395-d80b-4870-a6b4-ea5ae7baa52f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:26.081883 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-82325395-d80b-4870-a6b4-ea5ae7baa52f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:26.110528 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-82325395-d80b-4870-a6b4-ea5ae7baa52f tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041518 May 10 20:02:26.111084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 294/569] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:02:26 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:27.069643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e35aa46c-9738-4a66-9ba1-d7417e820fc6 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:27.070259 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e35aa46c-9738-4a66-9ba1-d7417e820fc6 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:27.076319 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e35aa46c-9738-4a66-9ba1-d7417e820fc6 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:27.076778 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e35aa46c-9738-4a66-9ba1-d7417e820fc6 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:27.077558 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e35aa46c-9738-4a66-9ba1-d7417e820fc6 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:27.078004 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e35aa46c-9738-4a66-9ba1-d7417e820fc6 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:27.121701 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b7be585f-9434-40ce-a49c-1e84a5522130 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:27.122932 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b7be585f-9434-40ce-a49c-1e84a5522130 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:27.129357 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b7be585f-9434-40ce-a49c-1e84a5522130 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:27.129812 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b7be585f-9434-40ce-a49c-1e84a5522130 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:27.130793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b7be585f-9434-40ce-a49c-1e84a5522130 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:27.131978 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b7be585f-9434-40ce-a49c-1e84a5522130 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:27.167905 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b7be585f-9434-40ce-a49c-1e84a5522130 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050586 May 10 20:02:27.168904 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 295/570] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:02:27 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:02:27.213024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e35aa46c-9738-4a66-9ba1-d7417e820fc6 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:27.221092 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e35aa46c-9738-4a66-9ba1-d7417e820fc6 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:27.223550 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e35aa46c-9738-4a66-9ba1-d7417e820fc6 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:27.224920 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e35aa46c-9738-4a66-9ba1-d7417e820fc6 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1739 microversion: 2.20 time: 0.159795 May 10 20:02:27.226502 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 276/571] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:27 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:27.241014 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4ea8955c-7d50-4104-b69c-e82dec54f7a2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:27.241650 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4ea8955c-7d50-4104-b69c-e82dec54f7a2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:27.247942 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4ea8955c-7d50-4104-b69c-e82dec54f7a2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:27.248327 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4ea8955c-7d50-4104-b69c-e82dec54f7a2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:27.249106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4ea8955c-7d50-4104-b69c-e82dec54f7a2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:27.249698 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4ea8955c-7d50-4104-b69c-e82dec54f7a2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:27.276337 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4ea8955c-7d50-4104-b69c-e82dec54f7a2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:02:27.365358 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4ea8955c-7d50-4104-b69c-e82dec54f7a2 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 204 len: 0 microversion: 2.1 time: 0.130305 May 10 20:02:27.365975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 296/572] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:02:27 2022] DELETE /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:02:27.377248 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-af7c7081-b0ad-4e09-b490-3c38a25ba74d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:27.378001 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-af7c7081-b0ad-4e09-b490-3c38a25ba74d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:27.384436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af7c7081-b0ad-4e09-b490-3c38a25ba74d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:27.385045 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af7c7081-b0ad-4e09-b490-3c38a25ba74d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:27.385987 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af7c7081-b0ad-4e09-b490-3c38a25ba74d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:27.386523 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af7c7081-b0ad-4e09-b490-3c38a25ba74d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:27.568779 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-af7c7081-b0ad-4e09-b490-3c38a25ba74d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:27.579349 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-af7c7081-b0ad-4e09-b490-3c38a25ba74d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1682 microversion: 2.1 time: 0.207047 May 10 20:02:27.579349 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 277/573] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:27 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:02:28.248400 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3fba75c0-bcf6-4c7d-a9fd-981deef306e2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:28.250026 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3fba75c0-bcf6-4c7d-a9fd-981deef306e2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:28.259168 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3fba75c0-bcf6-4c7d-a9fd-981deef306e2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:28.259784 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3fba75c0-bcf6-4c7d-a9fd-981deef306e2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:28.260586 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3fba75c0-bcf6-4c7d-a9fd-981deef306e2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:28.261028 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3fba75c0-bcf6-4c7d-a9fd-981deef306e2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:28.413121 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3fba75c0-bcf6-4c7d-a9fd-981deef306e2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:28.422516 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3fba75c0-bcf6-4c7d-a9fd-981deef306e2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:28.424913 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3fba75c0-bcf6-4c7d-a9fd-981deef306e2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:28.426986 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3fba75c0-bcf6-4c7d-a9fd-981deef306e2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1739 microversion: 2.20 time: 0.186395 May 10 20:02:28.427556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 297/574] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:28 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:28.557919 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-aaa210c9-7c2f-4333-ba6a-cef4691e42c6 req-90596fcb-5701-4c61-93fb-a61815a79c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff53e635-0740-4f22-9c5b-8d8dd47571c5", "name": "network-vif-plugged", "status": "completed", "tag": "740fa7f3-ee5c-4744-9541-a814cc75f111"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:02:28.568560 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-aaa210c9-7c2f-4333-ba6a-cef4691e42c6 req-90596fcb-5701-4c61-93fb-a61815a79c26 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:28.569334 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-aaa210c9-7c2f-4333-ba6a-cef4691e42c6 req-90596fcb-5701-4c61-93fb-a61815a79c26 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:28.582215 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-aaa210c9-7c2f-4333-ba6a-cef4691e42c6 req-90596fcb-5701-4c61-93fb-a61815a79c26 service nova] Creating event network-vif-plugged:740fa7f3-ee5c-4744-9541-a814cc75f111 for instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 on hv-cinder-84131 May 10 20:02:28.587299 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-aaa210c9-7c2f-4333-ba6a-cef4691e42c6 req-90596fcb-5701-4c61-93fb-a61815a79c26 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033272 May 10 20:02:28.588386 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 278/575] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:02:28.598789 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7e31dbaa-0de3-4fec-a77e-1233d46fe793 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:28.599615 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7e31dbaa-0de3-4fec-a77e-1233d46fe793 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:28.606122 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e31dbaa-0de3-4fec-a77e-1233d46fe793 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:28.606825 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e31dbaa-0de3-4fec-a77e-1233d46fe793 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:28.607878 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e31dbaa-0de3-4fec-a77e-1233d46fe793 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:28.611000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e31dbaa-0de3-4fec-a77e-1233d46fe793 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:28.770233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7e31dbaa-0de3-4fec-a77e-1233d46fe793 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:28.778702 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7e31dbaa-0de3-4fec-a77e-1233d46fe793 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1682 microversion: 2.1 time: 0.184387 May 10 20:02:28.780451 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 298/576] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:28 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:02:29.447793 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-70b71c19-352f-4cb9-b0c5-43d53e9300a9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:29.449003 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-70b71c19-352f-4cb9-b0c5-43d53e9300a9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:29.460248 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-70b71c19-352f-4cb9-b0c5-43d53e9300a9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:29.461129 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-70b71c19-352f-4cb9-b0c5-43d53e9300a9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:29.462848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-70b71c19-352f-4cb9-b0c5-43d53e9300a9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:29.463528 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-70b71c19-352f-4cb9-b0c5-43d53e9300a9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:29.761633 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-70b71c19-352f-4cb9-b0c5-43d53e9300a9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:29.769763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-70b71c19-352f-4cb9-b0c5-43d53e9300a9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:29.775236 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-70b71c19-352f-4cb9-b0c5-43d53e9300a9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:29.779496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-70b71c19-352f-4cb9-b0c5-43d53e9300a9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1739 microversion: 2.20 time: 0.338063 May 10 20:02:29.784094 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 279/577] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:29 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:29.796467 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5f59a89d-9d5c-4b98-ac09-ca1d2ddb8a2c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:29.797865 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5f59a89d-9d5c-4b98-ac09-ca1d2ddb8a2c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:29.806431 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f59a89d-9d5c-4b98-ac09-ca1d2ddb8a2c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:29.807102 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f59a89d-9d5c-4b98-ac09-ca1d2ddb8a2c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:29.808189 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f59a89d-9d5c-4b98-ac09-ca1d2ddb8a2c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:29.808755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f59a89d-9d5c-4b98-ac09-ca1d2ddb8a2c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:29.980864 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5f59a89d-9d5c-4b98-ac09-ca1d2ddb8a2c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2751fce03c284a91b152f545bd8c63ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477a9d7174e544efbbe7803ca7e77521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:29.989778 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5f59a89d-9d5c-4b98-ac09-ca1d2ddb8a2c tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 200 len: 1682 microversion: 2.1 time: 0.197266 May 10 20:02:29.990641 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 299/578] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:29 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:02:30.385765 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-4bdf9f87-a090-4214-9b52-436e4fe90229 req-c325552d-9ac4-4ace-bf15-43a443038e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837a7763-9305-4f62-b70e-d633f834892f", "name": "network-vif-deleted", "tag": "a4f6c88d-29e5-469b-8cef-1c56e40295d8"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:02:30.396249 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4bdf9f87-a090-4214-9b52-436e4fe90229 req-c325552d-9ac4-4ace-bf15-43a443038e20 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:30.397900 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4bdf9f87-a090-4214-9b52-436e4fe90229 req-c325552d-9ac4-4ace-bf15-43a443038e20 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:30.436475 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-4bdf9f87-a090-4214-9b52-436e4fe90229 req-c325552d-9ac4-4ace-bf15-43a443038e20 service nova] Creating event network-vif-deleted:a4f6c88d-29e5-469b-8cef-1c56e40295d8 for instance 837a7763-9305-4f62-b70e-d633f834892f on hv-cinder-84131 May 10 20:02:30.451759 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-4bdf9f87-a090-4214-9b52-436e4fe90229 req-c325552d-9ac4-4ace-bf15-43a443038e20 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069917 May 10 20:02:30.452391 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 280/579] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:30.800926 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3e97378f-1ee6-4c48-a0a0-782a84c8cac3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:30.802201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3e97378f-1ee6-4c48-a0a0-782a84c8cac3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:30.809646 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3e97378f-1ee6-4c48-a0a0-782a84c8cac3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:30.810420 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3e97378f-1ee6-4c48-a0a0-782a84c8cac3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:30.811998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3e97378f-1ee6-4c48-a0a0-782a84c8cac3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:30.812602 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3e97378f-1ee6-4c48-a0a0-782a84c8cac3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:31.010580 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d7863c20-cee5-4539-86df-ec1166ff6a22 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:31.012250 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d7863c20-cee5-4539-86df-ec1166ff6a22 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:31.026883 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d7863c20-cee5-4539-86df-ec1166ff6a22 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:31.028538 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d7863c20-cee5-4539-86df-ec1166ff6a22 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:31.032401 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d7863c20-cee5-4539-86df-ec1166ff6a22 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:31.034822 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d7863c20-cee5-4539-86df-ec1166ff6a22 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:31.055679 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3e97378f-1ee6-4c48-a0a0-782a84c8cac3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:31.063930 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3e97378f-1ee6-4c48-a0a0-782a84c8cac3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:31.065448 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3e97378f-1ee6-4c48-a0a0-782a84c8cac3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:31.067220 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3e97378f-1ee6-4c48-a0a0-782a84c8cac3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1739 microversion: 2.20 time: 0.269709 May 10 20:02:31.078859 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 300/580] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:30 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:31.094268 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-d7863c20-cee5-4539-86df-ec1166ff6a22 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d7863c20-cee5-4539-86df-ec1166ff6a22 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f HTTP/1.1 May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:02:31.098643 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:31.100343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '837a7763-9305-4f62-b70e-d633f834892f'} May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:31.101263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:31.102795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:31.103910 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d7863c20-cee5-4539-86df-ec1166ff6a22 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:31.103910 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d7863c20-cee5-4539-86df-ec1166ff6a22 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 404 len: 111 microversion: 2.1 time: 0.096281 May 10 20:02:31.103910 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 281/581] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:31 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:31.111273 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-49d0ea2c-f10c-49d3-a094-b46c74992064 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '.version_select at 0x7fdd391d2e50>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:31.141942 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-49d0ea2c-f10c-49d3-a094-b46c74992064 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-353311215" status: 202 len: 0 microversion: 2.1 time: 0.034476 May 10 20:02:31.142823 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 301/582] 10.222.0.57 () {58 vars in 1217 bytes} [Tue May 10 20:02:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-353311215 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:02:32.085443 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-50a8db4e-9519-4b8c-bfb6-aff803593aa5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:32.086042 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-50a8db4e-9519-4b8c-bfb6-aff803593aa5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:32.098316 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-50a8db4e-9519-4b8c-bfb6-aff803593aa5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:32.098810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-50a8db4e-9519-4b8c-bfb6-aff803593aa5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:32.099597 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-50a8db4e-9519-4b8c-bfb6-aff803593aa5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:32.103241 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-50a8db4e-9519-4b8c-bfb6-aff803593aa5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:32.377634 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-50a8db4e-9519-4b8c-bfb6-aff803593aa5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:32.398213 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-50a8db4e-9519-4b8c-bfb6-aff803593aa5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:32.408308 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-50a8db4e-9519-4b8c-bfb6-aff803593aa5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:32.412541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-50a8db4e-9519-4b8c-bfb6-aff803593aa5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1739 microversion: 2.20 time: 0.331291 May 10 20:02:32.413183 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 282/583] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:32 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1739 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:33.259504 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-765a9ed4-2c9f-4dd7-b1c5-a6ef5094032e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:33.260102 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-765a9ed4-2c9f-4dd7-b1c5-a6ef5094032e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:33.267119 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-765a9ed4-2c9f-4dd7-b1c5-a6ef5094032e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:33.267575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-765a9ed4-2c9f-4dd7-b1c5-a6ef5094032e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:33.268372 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-765a9ed4-2c9f-4dd7-b1c5-a6ef5094032e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:33.268793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-765a9ed4-2c9f-4dd7-b1c5-a6ef5094032e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:33.291963 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-765a9ed4-2c9f-4dd7-b1c5-a6ef5094032e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-765a9ed4-2c9f-4dd7-b1c5-a6ef5094032e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: DELETE /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f HTTP/1.1 May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:02:33.293783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:33.295230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '837a7763-9305-4f62-b70e-d633f834892f'} May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:33.296099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:33.297486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:33.298887 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-765a9ed4-2c9f-4dd7-b1c5-a6ef5094032e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:33.298887 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-765a9ed4-2c9f-4dd7-b1c5-a6ef5094032e tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 404 len: 111 microversion: 2.1 time: 0.042402 May 10 20:02:33.299589 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 302/584] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:02:33 2022] DELETE /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:33.308297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0953a00e-1a4d-4af3-a518-99370d8c8f8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:33.309068 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0953a00e-1a4d-4af3-a518-99370d8c8f8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 837a7763-9305-4f62-b70e-d633f834892f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:33.315721 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0953a00e-1a4d-4af3-a518-99370d8c8f8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:33.316934 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0953a00e-1a4d-4af3-a518-99370d8c8f8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:33.317767 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0953a00e-1a4d-4af3-a518-99370d8c8f8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:33.318719 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0953a00e-1a4d-4af3-a518-99370d8c8f8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:33.334907 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-0953a00e-1a4d-4af3-a518-99370d8c8f8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0953a00e-1a4d-4af3-a518-99370d8c8f8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f HTTP/1.1 May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:02:33.336727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:33.338297 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '837a7763-9305-4f62-b70e-d633f834892f'} May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:33.339175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. May 10 20:02:33.340533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:33.343020 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0953a00e-1a4d-4af3-a518-99370d8c8f8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance 837a7763-9305-4f62-b70e-d633f834892f could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:33.344042 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0953a00e-1a4d-4af3-a518-99370d8c8f8d tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f" status: 404 len: 111 microversion: 2.1 time: 0.040365 May 10 20:02:33.344594 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 283/585] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:33 2022] GET /compute/v2.1/servers/837a7763-9305-4f62-b70e-d633f834892f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:33.433134 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8de54f60-bef5-4199-aeeb-e32b9e123c9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:33.434103 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8de54f60-bef5-4199-aeeb-e32b9e123c9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:33.446476 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8de54f60-bef5-4199-aeeb-e32b9e123c9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:33.447178 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8de54f60-bef5-4199-aeeb-e32b9e123c9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:33.451042 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8de54f60-bef5-4199-aeeb-e32b9e123c9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:33.451565 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8de54f60-bef5-4199-aeeb-e32b9e123c9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:33.620681 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8de54f60-bef5-4199-aeeb-e32b9e123c9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:33.635091 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8de54f60-bef5-4199-aeeb-e32b9e123c9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:33.636517 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8de54f60-bef5-4199-aeeb-e32b9e123c9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:33.637818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8de54f60-bef5-4199-aeeb-e32b9e123c9f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1739 microversion: 2.20 time: 0.210080 May 10 20:02:33.638801 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 303/586] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:33 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:34.506118 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b1d47923-f6c8-4bf0-9071-20bd64cbe062 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:34.506909 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b1d47923-f6c8-4bf0-9071-20bd64cbe062 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:34.514403 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b1d47923-f6c8-4bf0-9071-20bd64cbe062 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:34.515809 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b1d47923-f6c8-4bf0-9071-20bd64cbe062 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:34.528999 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b1d47923-f6c8-4bf0-9071-20bd64cbe062 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:34.529838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b1d47923-f6c8-4bf0-9071-20bd64cbe062 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:34.545369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-b1d47923-f6c8-4bf0-9071-20bd64cbe062 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b1d47923-f6c8-4bf0-9071-20bd64cbe062 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: DELETE /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df HTTP/1.1 May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:02:34.547612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:02:34.549174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '4e180d6e-d6c1-42af-9852-5048dde008df'} May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:34.550089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:02:34.552120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:34.554883 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b1d47923-f6c8-4bf0-9071-20bd64cbe062 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:34.555954 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b1d47923-f6c8-4bf0-9071-20bd64cbe062 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 404 len: 111 microversion: 2.1 time: 0.054621 May 10 20:02:34.560510 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 284/587] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:02:34 2022] DELETE /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:34.564875 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8aaa1f06-c169-4cef-865a-eda1975de28b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:34.565606 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8aaa1f06-c169-4cef-865a-eda1975de28b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 4e180d6e-d6c1-42af-9852-5048dde008df] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:34.572575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8aaa1f06-c169-4cef-865a-eda1975de28b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:34.573034 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8aaa1f06-c169-4cef-865a-eda1975de28b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:34.574164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8aaa1f06-c169-4cef-865a-eda1975de28b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:34.574634 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8aaa1f06-c169-4cef-865a-eda1975de28b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:34.592642 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-8aaa1f06-c169-4cef-865a-eda1975de28b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8aaa1f06-c169-4cef-865a-eda1975de28b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df HTTP/1.1 May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:02:34.594352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:02:34.595683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '4e180d6e-d6c1-42af-9852-5048dde008df'} May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:34.596409 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. May 10 20:02:34.598226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:34.600893 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8aaa1f06-c169-4cef-865a-eda1975de28b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance 4e180d6e-d6c1-42af-9852-5048dde008df could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:34.601839 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8aaa1f06-c169-4cef-865a-eda1975de28b tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df" status: 404 len: 111 microversion: 2.1 time: 0.040959 May 10 20:02:34.602844 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 304/588] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:34 2022] GET /compute/v2.1/servers/4e180d6e-d6c1-42af-9852-5048dde008df => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:34.610610 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e66f409a-3756-40cd-8078-cfd84d9d44cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:34.611246 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e66f409a-3756-40cd-8078-cfd84d9d44cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:34.617798 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e66f409a-3756-40cd-8078-cfd84d9d44cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:34.618595 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e66f409a-3756-40cd-8078-cfd84d9d44cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:34.619606 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e66f409a-3756-40cd-8078-cfd84d9d44cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:34.620237 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e66f409a-3756-40cd-8078-cfd84d9d44cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:34.640121 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-e66f409a-3756-40cd-8078-cfd84d9d44cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e66f409a-3756-40cd-8078-cfd84d9d44cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: DELETE /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 HTTP/1.1 May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:02:34.641826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 20:02:34.643282 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '48eda565-f37d-4e78-a9e2-660d73a4de06'} May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:34.644139 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 20:02:34.649164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:02:34.650682 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e66f409a-3756-40cd-8078-cfd84d9d44cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:34.650682 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e66f409a-3756-40cd-8078-cfd84d9d44cc tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 404 len: 111 microversion: 2.1 time: 0.037429 May 10 20:02:34.650682 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 285/589] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:02:34 2022] DELETE /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:02:34.655611 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f85842c5-ff92-4d50-8972-fc15a8efb530 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:34.656311 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f85842c5-ff92-4d50-8972-fc15a8efb530 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: 48eda565-f37d-4e78-a9e2-660d73a4de06] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:34.656699 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2b2b8a84-87b7-4d6b-82f8-164a7554db2f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:34.657370 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2b2b8a84-87b7-4d6b-82f8-164a7554db2f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:34.665322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2b2b8a84-87b7-4d6b-82f8-164a7554db2f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:34.666226 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2b2b8a84-87b7-4d6b-82f8-164a7554db2f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:34.667575 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2b2b8a84-87b7-4d6b-82f8-164a7554db2f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:34.667704 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f85842c5-ff92-4d50-8972-fc15a8efb530 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:34.668255 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f85842c5-ff92-4d50-8972-fc15a8efb530 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:34.668405 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2b2b8a84-87b7-4d6b-82f8-164a7554db2f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:34.669777 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f85842c5-ff92-4d50-8972-fc15a8efb530 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:34.669777 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f85842c5-ff92-4d50-8972-fc15a8efb530 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:34.686874 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-f85842c5-ff92-4d50-8972-fc15a8efb530 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f85842c5-ff92-4d50-8972-fc15a8efb530 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 HTTP/1.1 May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:02:34.694201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 20:02:34.695765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '48eda565-f37d-4e78-a9e2-660d73a4de06'} May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:34.696626 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. May 10 20:02:34.698125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:34.705546 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f85842c5-ff92-4d50-8972-fc15a8efb530 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance 48eda565-f37d-4e78-a9e2-660d73a4de06 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:34.707678 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f85842c5-ff92-4d50-8972-fc15a8efb530 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06" status: 404 len: 111 microversion: 2.1 time: 0.055637 May 10 20:02:34.709877 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 305/590] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:34 2022] GET /compute/v2.1/servers/48eda565-f37d-4e78-a9e2-660d73a4de06 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:34.920221 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2b2b8a84-87b7-4d6b-82f8-164a7554db2f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:34.928983 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2b2b8a84-87b7-4d6b-82f8-164a7554db2f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:34.931948 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2b2b8a84-87b7-4d6b-82f8-164a7554db2f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:34.933364 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2b2b8a84-87b7-4d6b-82f8-164a7554db2f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1739 microversion: 2.20 time: 0.280556 May 10 20:02:34.934404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 286/591] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:34 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:02:35.943981 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b61b1689-9374-491c-92d7-811ff0289281 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:35.944555 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b61b1689-9374-491c-92d7-811ff0289281 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:35.953038 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-268b3983-9884-4068-8a42-40164bd43e4b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:35.953593 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b61b1689-9374-491c-92d7-811ff0289281 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:35.953593 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b61b1689-9374-491c-92d7-811ff0289281 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:35.954291 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b61b1689-9374-491c-92d7-811ff0289281 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:35.954904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-268b3983-9884-4068-8a42-40164bd43e4b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:35.955302 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b61b1689-9374-491c-92d7-811ff0289281 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:35.962413 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-268b3983-9884-4068-8a42-40164bd43e4b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:35.963030 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-268b3983-9884-4068-8a42-40164bd43e4b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:35.963912 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-268b3983-9884-4068-8a42-40164bd43e4b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:35.964638 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-268b3983-9884-4068-8a42-40164bd43e4b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:35.970714 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-b61b1689-9374-491c-92d7-811ff0289281 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b61b1689-9374-491c-92d7-811ff0289281 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: DELETE /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 HTTP/1.1 May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:02:35.972587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:02:35.974158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': 'd737aa62-3e89-4485-a6ab-65267418ce57'} May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:35.975098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:02:35.976645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:35.978827 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b61b1689-9374-491c-92d7-811ff0289281 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:35.979855 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b61b1689-9374-491c-92d7-811ff0289281 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 404 len: 111 microversion: 2.1 time: 0.040339 May 10 20:02:35.980959 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 306/592] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:02:35 2022] DELETE /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:35.993847 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-197f62c5-f03c-4643-83c0-42451e25ad61 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:35.996147 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-197f62c5-f03c-4643-83c0-42451e25ad61 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] [instance: d737aa62-3e89-4485-a6ab-65267418ce57] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:36.007853 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-197f62c5-f03c-4643-83c0-42451e25ad61 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:36.008738 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-197f62c5-f03c-4643-83c0-42451e25ad61 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:36.009739 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-197f62c5-f03c-4643-83c0-42451e25ad61 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:36.010304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-197f62c5-f03c-4643-83c0-42451e25ad61 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:36.042319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-197f62c5-f03c-4643-83c0-42451e25ad61 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] HTTP exception thrown: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-197f62c5-f03c-4643-83c0-42451e25ad61 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Request method failure captured: May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 HTTP/1.1 May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesNlsaiCgnLdvXc6Z4fajk8L25nr202Lsi12vjkBmXegT3Owmm5u3ee8Xtvxy071lNUQqKCS27zyjbz77I-tif4TtP80q_rJyG6ioU-w9oRWPbddB3XHXvdOGgmO50SCG1rsii3JouW2VI5iDLZVEB9nTW-9jTOSZogX0YQZRm7EfS0 May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:02:36.044818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_477a9d7174e544efbbe7803ca7e77521", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/477a9d7174e544efbbe7803ca7e77521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/477a9d7174e544efbbe7803ca7e77521"}]}] May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 477a9d7174e544efbbe7803ca7e77521 May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233257892 May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 2751fce03c284a91b152f545bd8c63ce May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeNegativeTest-233257892-project May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:02:36.046167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': 'd737aa62-3e89-4485-a6ab-65267418ce57'} May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:02:36.046982 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. May 10 20:02:36.048461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:02:36.049739 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-197f62c5-f03c-4643-83c0-42451e25ad61 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] Returning 404 to user: Instance d737aa62-3e89-4485-a6ab-65267418ce57 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:02:36.055384 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-197f62c5-f03c-4643-83c0-42451e25ad61 tempest-AttachVolumeNegativeTest-233257892 tempest-AttachVolumeNegativeTest-233257892-project] 10.222.0.57 "GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57" status: 404 len: 111 microversion: 2.1 time: 0.061571 May 10 20:02:36.056306 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 307/593] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:35 2022] GET /compute/v2.1/servers/d737aa62-3e89-4485-a6ab-65267418ce57 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:02:36.127407 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-268b3983-9884-4068-8a42-40164bd43e4b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:36.137075 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-268b3983-9884-4068-8a42-40164bd43e4b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:36.138721 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-268b3983-9884-4068-8a42-40164bd43e4b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:36.139891 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-268b3983-9884-4068-8a42-40164bd43e4b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1739 microversion: 2.20 time: 0.191452 May 10 20:02:36.151046 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 287/594] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:35 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:02:37.161197 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-14250147-bc62-4340-aad9-496299c5885d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:37.162807 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-14250147-bc62-4340-aad9-496299c5885d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:37.170938 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14250147-bc62-4340-aad9-496299c5885d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:37.171800 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14250147-bc62-4340-aad9-496299c5885d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:37.173340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14250147-bc62-4340-aad9-496299c5885d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:37.174065 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14250147-bc62-4340-aad9-496299c5885d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:37.381249 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-14250147-bc62-4340-aad9-496299c5885d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:37.392759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-14250147-bc62-4340-aad9-496299c5885d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:37.394658 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-14250147-bc62-4340-aad9-496299c5885d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:37.396090 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-14250147-bc62-4340-aad9-496299c5885d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1739 microversion: 2.20 time: 0.241057 May 10 20:02:37.407713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 308/595] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:37 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:38.415109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8f6d7fc9-aac4-414c-b654-b3d28bdc75fd tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:38.415722 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8f6d7fc9-aac4-414c-b654-b3d28bdc75fd tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:38.422258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f6d7fc9-aac4-414c-b654-b3d28bdc75fd tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:38.422812 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f6d7fc9-aac4-414c-b654-b3d28bdc75fd tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:38.423792 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f6d7fc9-aac4-414c-b654-b3d28bdc75fd tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:38.424310 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f6d7fc9-aac4-414c-b654-b3d28bdc75fd tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:38.585758 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8f6d7fc9-aac4-414c-b654-b3d28bdc75fd tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:38.596316 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8f6d7fc9-aac4-414c-b654-b3d28bdc75fd tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:38.598862 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8f6d7fc9-aac4-414c-b654-b3d28bdc75fd tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:38.600728 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8f6d7fc9-aac4-414c-b654-b3d28bdc75fd tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1739 microversion: 2.20 time: 0.189435 May 10 20:02:38.601810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 288/596] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:38 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:39.619672 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d5ab3485-3a6c-44ad-9e1c-b98c17efe333 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:39.620331 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d5ab3485-3a6c-44ad-9e1c-b98c17efe333 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:39.626796 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d5ab3485-3a6c-44ad-9e1c-b98c17efe333 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:39.627249 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d5ab3485-3a6c-44ad-9e1c-b98c17efe333 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:39.628056 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d5ab3485-3a6c-44ad-9e1c-b98c17efe333 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:39.628496 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d5ab3485-3a6c-44ad-9e1c-b98c17efe333 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:39.769921 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d5ab3485-3a6c-44ad-9e1c-b98c17efe333 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:39.784178 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d5ab3485-3a6c-44ad-9e1c-b98c17efe333 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:39.786384 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d5ab3485-3a6c-44ad-9e1c-b98c17efe333 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:39.792550 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d5ab3485-3a6c-44ad-9e1c-b98c17efe333 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1721 microversion: 2.20 time: 0.176509 May 10 20:02:39.793836 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 309/597] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:39 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:40.510390 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-2f60cc0c-c835-4704-9109-70f5fce0f702 req-70866450-f039-4bf1-89a8-875ca383c44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff53e635-0740-4f22-9c5b-8d8dd47571c5", "name": "network-vif-unplugged", "status": "completed", "tag": "740fa7f3-ee5c-4744-9541-a814cc75f111"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:02:40.520468 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-2f60cc0c-c835-4704-9109-70f5fce0f702 req-70866450-f039-4bf1-89a8-875ca383c44b service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:40.521309 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-2f60cc0c-c835-4704-9109-70f5fce0f702 req-70866450-f039-4bf1-89a8-875ca383c44b service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:40.536689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-2f60cc0c-c835-4704-9109-70f5fce0f702 req-70866450-f039-4bf1-89a8-875ca383c44b service nova] Creating event network-vif-unplugged:740fa7f3-ee5c-4744-9541-a814cc75f111 for instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 on hv-cinder-84131 May 10 20:02:40.541932 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-2f60cc0c-c835-4704-9109-70f5fce0f702 req-70866450-f039-4bf1-89a8-875ca383c44b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036075 May 10 20:02:40.542571 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 289/598] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:02:40.810969 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-284b5c49-c6da-43d6-860d-f42906cef828 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:40.811903 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-284b5c49-c6da-43d6-860d-f42906cef828 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:40.818994 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-284b5c49-c6da-43d6-860d-f42906cef828 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:40.819499 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-284b5c49-c6da-43d6-860d-f42906cef828 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:40.820295 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-284b5c49-c6da-43d6-860d-f42906cef828 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:40.820737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-284b5c49-c6da-43d6-860d-f42906cef828 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:40.968601 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-284b5c49-c6da-43d6-860d-f42906cef828 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:40.976491 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-284b5c49-c6da-43d6-860d-f42906cef828 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:40.978749 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-284b5c49-c6da-43d6-860d-f42906cef828 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:40.979916 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-284b5c49-c6da-43d6-860d-f42906cef828 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1721 microversion: 2.20 time: 0.172733 May 10 20:02:40.980674 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 310/599] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:40 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:42.001148 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2bac8d27-6278-45e8-9016-6c0f4569a212 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:42.001859 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2bac8d27-6278-45e8-9016-6c0f4569a212 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:42.008601 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2bac8d27-6278-45e8-9016-6c0f4569a212 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:42.009058 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2bac8d27-6278-45e8-9016-6c0f4569a212 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:42.009838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2bac8d27-6278-45e8-9016-6c0f4569a212 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:42.010278 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2bac8d27-6278-45e8-9016-6c0f4569a212 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:42.151689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2bac8d27-6278-45e8-9016-6c0f4569a212 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:42.160244 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2bac8d27-6278-45e8-9016-6c0f4569a212 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:42.161765 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2bac8d27-6278-45e8-9016-6c0f4569a212 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:42.162993 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2bac8d27-6278-45e8-9016-6c0f4569a212 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1664 microversion: 2.20 time: 0.166865 May 10 20:02:42.163554 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 290/600] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:41 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:42.181252 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f400968c-aa26-4541-9e71-57e48e0111ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e6c38eb-7dee-4441-94de-9ffacb2dc3ac"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:02:42.182322 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f400968c-aa26-4541-9e71-57e48e0111ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:42.189164 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f400968c-aa26-4541-9e71-57e48e0111ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:42.189624 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f400968c-aa26-4541-9e71-57e48e0111ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:42.190405 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f400968c-aa26-4541-9e71-57e48e0111ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:42.191058 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f400968c-aa26-4541-9e71-57e48e0111ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:42.538555 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f400968c-aa26-4541-9e71-57e48e0111ec tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "POST /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.361031 May 10 20:02:42.539312 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 311/601] 10.222.0.57 () {62 vars in 1363 bytes} [Tue May 10 20:02:42 2022] POST /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-volume_attachments => generated 188 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:02:42.663680 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8e9add2a-d1c3-4539-b741-0a3c92c20ce2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:02:42.664340 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8e9add2a-d1c3-4539-b741-0a3c92c20ce2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:42.670492 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e9add2a-d1c3-4539-b741-0a3c92c20ce2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:42.671033 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e9add2a-d1c3-4539-b741-0a3c92c20ce2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:42.671878 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e9add2a-d1c3-4539-b741-0a3c92c20ce2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:42.672719 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e9add2a-d1c3-4539-b741-0a3c92c20ce2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:42.777083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8e9add2a-d1c3-4539-b741-0a3c92c20ce2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "POST /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/action" status: 202 len: 0 microversion: 2.20 time: 0.117999 May 10 20:02:42.777915 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 291/602] 10.222.0.57 () {62 vars in 1318 bytes} [Tue May 10 20:02:42 2022] POST /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:02:42.787714 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c93322ad-2c7a-4fa2-9e3c-1cfa9c42a066 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:42.789436 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c93322ad-2c7a-4fa2-9e3c-1cfa9c42a066 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:42.799321 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c93322ad-2c7a-4fa2-9e3c-1cfa9c42a066 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:42.799990 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c93322ad-2c7a-4fa2-9e3c-1cfa9c42a066 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:42.801423 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c93322ad-2c7a-4fa2-9e3c-1cfa9c42a066 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:42.801944 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c93322ad-2c7a-4fa2-9e3c-1cfa9c42a066 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:42.954375 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c93322ad-2c7a-4fa2-9e3c-1cfa9c42a066 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:42.964078 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c93322ad-2c7a-4fa2-9e3c-1cfa9c42a066 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:42.965710 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c93322ad-2c7a-4fa2-9e3c-1cfa9c42a066 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:42.967021 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c93322ad-2c7a-4fa2-9e3c-1cfa9c42a066 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1750 microversion: 2.20 time: 0.184321 May 10 20:02:42.977991 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 312/603] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:42 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:02:43.986327 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3928e7df-c580-494c-8bd8-13de25b64a97 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:43.986972 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3928e7df-c580-494c-8bd8-13de25b64a97 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:43.993835 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3928e7df-c580-494c-8bd8-13de25b64a97 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:43.994547 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3928e7df-c580-494c-8bd8-13de25b64a97 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:43.995693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3928e7df-c580-494c-8bd8-13de25b64a97 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:43.996491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3928e7df-c580-494c-8bd8-13de25b64a97 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:44.167598 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3928e7df-c580-494c-8bd8-13de25b64a97 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:44.176650 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3928e7df-c580-494c-8bd8-13de25b64a97 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:44.179843 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3928e7df-c580-494c-8bd8-13de25b64a97 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:44.181426 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3928e7df-c580-494c-8bd8-13de25b64a97 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1750 microversion: 2.20 time: 0.199910 May 10 20:02:44.182341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 292/604] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:43 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1750 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:02:45.200209 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a1df9cbc-1978-4b42-9e48-d68c1447c219 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:45.200827 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a1df9cbc-1978-4b42-9e48-d68c1447c219 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:45.207439 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a1df9cbc-1978-4b42-9e48-d68c1447c219 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:45.208109 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a1df9cbc-1978-4b42-9e48-d68c1447c219 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:45.209429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a1df9cbc-1978-4b42-9e48-d68c1447c219 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:45.210043 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a1df9cbc-1978-4b42-9e48-d68c1447c219 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:45.343406 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a1df9cbc-1978-4b42-9e48-d68c1447c219 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:45.373285 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a1df9cbc-1978-4b42-9e48-d68c1447c219 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:45.374843 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a1df9cbc-1978-4b42-9e48-d68c1447c219 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:45.376020 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a1df9cbc-1978-4b42-9e48-d68c1447c219 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1752 microversion: 2.20 time: 0.180238 May 10 20:02:45.376973 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 313/605] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:45 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:46.396037 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2a22bb6c-f33d-4218-82cd-789e83f5b765 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:46.397884 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2a22bb6c-f33d-4218-82cd-789e83f5b765 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:46.404995 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a22bb6c-f33d-4218-82cd-789e83f5b765 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:46.405453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a22bb6c-f33d-4218-82cd-789e83f5b765 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:46.406221 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a22bb6c-f33d-4218-82cd-789e83f5b765 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:46.407042 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a22bb6c-f33d-4218-82cd-789e83f5b765 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:46.591101 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2a22bb6c-f33d-4218-82cd-789e83f5b765 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:46.599840 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2a22bb6c-f33d-4218-82cd-789e83f5b765 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:46.605241 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2a22bb6c-f33d-4218-82cd-789e83f5b765 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:46.606448 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2a22bb6c-f33d-4218-82cd-789e83f5b765 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.215093 May 10 20:02:46.607305 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 293/606] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:46 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:47.625837 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b6c35216-6ed3-4ac1-a006-70b2469c02a1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:47.626558 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b6c35216-6ed3-4ac1-a006-70b2469c02a1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:47.637692 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6c35216-6ed3-4ac1-a006-70b2469c02a1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:47.638075 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6c35216-6ed3-4ac1-a006-70b2469c02a1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:47.639084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6c35216-6ed3-4ac1-a006-70b2469c02a1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:47.639846 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6c35216-6ed3-4ac1-a006-70b2469c02a1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:47.836268 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b6c35216-6ed3-4ac1-a006-70b2469c02a1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:47.862641 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b6c35216-6ed3-4ac1-a006-70b2469c02a1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:47.867512 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b6c35216-6ed3-4ac1-a006-70b2469c02a1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:47.868720 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b6c35216-6ed3-4ac1-a006-70b2469c02a1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.247346 May 10 20:02:47.881955 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 314/607] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:47 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:48.889058 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cd1c19ae-e3ed-4a10-92bc-5ae7b2b7f1f0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:48.889782 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cd1c19ae-e3ed-4a10-92bc-5ae7b2b7f1f0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:48.896534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cd1c19ae-e3ed-4a10-92bc-5ae7b2b7f1f0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:48.896982 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cd1c19ae-e3ed-4a10-92bc-5ae7b2b7f1f0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:48.897749 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cd1c19ae-e3ed-4a10-92bc-5ae7b2b7f1f0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:48.898183 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cd1c19ae-e3ed-4a10-92bc-5ae7b2b7f1f0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:49.104421 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cd1c19ae-e3ed-4a10-92bc-5ae7b2b7f1f0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:49.126904 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cd1c19ae-e3ed-4a10-92bc-5ae7b2b7f1f0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:49.128678 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cd1c19ae-e3ed-4a10-92bc-5ae7b2b7f1f0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:49.130863 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cd1c19ae-e3ed-4a10-92bc-5ae7b2b7f1f0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.244979 May 10 20:02:49.131712 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 294/608] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:48 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:02:50.149929 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9fc70c02-84a0-49ca-83b5-05760dcf343e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:50.152432 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9fc70c02-84a0-49ca-83b5-05760dcf343e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:50.161887 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fc70c02-84a0-49ca-83b5-05760dcf343e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:50.162874 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fc70c02-84a0-49ca-83b5-05760dcf343e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:50.164364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fc70c02-84a0-49ca-83b5-05760dcf343e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:50.165163 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fc70c02-84a0-49ca-83b5-05760dcf343e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:50.328009 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9fc70c02-84a0-49ca-83b5-05760dcf343e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:50.339787 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9fc70c02-84a0-49ca-83b5-05760dcf343e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:50.341383 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9fc70c02-84a0-49ca-83b5-05760dcf343e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:50.342724 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9fc70c02-84a0-49ca-83b5-05760dcf343e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.197743 May 10 20:02:50.354150 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 315/609] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:50 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:51.361172 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4f574b6f-6221-40d8-bc4b-3ac23a8fe2be tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:51.361812 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4f574b6f-6221-40d8-bc4b-3ac23a8fe2be tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:51.368815 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f574b6f-6221-40d8-bc4b-3ac23a8fe2be tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:51.369283 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f574b6f-6221-40d8-bc4b-3ac23a8fe2be tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:51.370069 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f574b6f-6221-40d8-bc4b-3ac23a8fe2be tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:51.370638 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f574b6f-6221-40d8-bc4b-3ac23a8fe2be tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:51.540079 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4f574b6f-6221-40d8-bc4b-3ac23a8fe2be tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:51.552991 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4f574b6f-6221-40d8-bc4b-3ac23a8fe2be tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:51.554535 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4f574b6f-6221-40d8-bc4b-3ac23a8fe2be tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:51.555901 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4f574b6f-6221-40d8-bc4b-3ac23a8fe2be tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.198620 May 10 20:02:51.556793 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 295/610] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:51 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:02:52.574157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-46ea9943-c0b3-471e-ba12-f660741575ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:52.574798 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-46ea9943-c0b3-471e-ba12-f660741575ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:52.581235 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-46ea9943-c0b3-471e-ba12-f660741575ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:52.581694 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-46ea9943-c0b3-471e-ba12-f660741575ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:52.582499 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-46ea9943-c0b3-471e-ba12-f660741575ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:52.584306 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-46ea9943-c0b3-471e-ba12-f660741575ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:52.779581 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-46ea9943-c0b3-471e-ba12-f660741575ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:52.789481 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-46ea9943-c0b3-471e-ba12-f660741575ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:52.791706 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-46ea9943-c0b3-471e-ba12-f660741575ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:52.793106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-46ea9943-c0b3-471e-ba12-f660741575ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.222805 May 10 20:02:52.801305 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 316/611] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:52 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:53.812788 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-289ec18a-76e2-4d5a-9214-5627e0aca9e0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:53.813366 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-289ec18a-76e2-4d5a-9214-5627e0aca9e0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:53.819646 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-289ec18a-76e2-4d5a-9214-5627e0aca9e0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:53.820095 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-289ec18a-76e2-4d5a-9214-5627e0aca9e0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:53.820860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-289ec18a-76e2-4d5a-9214-5627e0aca9e0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:53.821291 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-289ec18a-76e2-4d5a-9214-5627e0aca9e0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:53.969245 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-289ec18a-76e2-4d5a-9214-5627e0aca9e0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:53.979012 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-289ec18a-76e2-4d5a-9214-5627e0aca9e0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:53.980739 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-289ec18a-76e2-4d5a-9214-5627e0aca9e0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:53.982445 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-289ec18a-76e2-4d5a-9214-5627e0aca9e0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.173790 May 10 20:02:53.983034 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 296/612] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:53 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:55.010644 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-501fde63-ff1e-49fb-9ebc-59ca4586a121 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:55.011379 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-501fde63-ff1e-49fb-9ebc-59ca4586a121 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:55.018509 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-501fde63-ff1e-49fb-9ebc-59ca4586a121 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:55.019268 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-501fde63-ff1e-49fb-9ebc-59ca4586a121 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:55.020842 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-501fde63-ff1e-49fb-9ebc-59ca4586a121 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:55.021494 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-501fde63-ff1e-49fb-9ebc-59ca4586a121 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:55.179017 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-501fde63-ff1e-49fb-9ebc-59ca4586a121 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:55.190144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-501fde63-ff1e-49fb-9ebc-59ca4586a121 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:55.191882 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-501fde63-ff1e-49fb-9ebc-59ca4586a121 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:55.193870 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-501fde63-ff1e-49fb-9ebc-59ca4586a121 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.196218 May 10 20:02:55.194573 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 317/613] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:54 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:56.212305 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ecf9acff-ad9c-46dd-b200-2c661e4c03e7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:56.212922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ecf9acff-ad9c-46dd-b200-2c661e4c03e7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:56.218961 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecf9acff-ad9c-46dd-b200-2c661e4c03e7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:56.219415 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecf9acff-ad9c-46dd-b200-2c661e4c03e7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:56.220191 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecf9acff-ad9c-46dd-b200-2c661e4c03e7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:56.220612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecf9acff-ad9c-46dd-b200-2c661e4c03e7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:56.347514 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ecf9acff-ad9c-46dd-b200-2c661e4c03e7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:56.355649 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ecf9acff-ad9c-46dd-b200-2c661e4c03e7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:56.357201 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ecf9acff-ad9c-46dd-b200-2c661e4c03e7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:56.358361 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ecf9acff-ad9c-46dd-b200-2c661e4c03e7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.150003 May 10 20:02:56.358984 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 297/614] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:56 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:56.554214 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1891308889", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "networks": [{"uuid": "34a5cd18-91cb-4e78-aa92-8274c4753fdd"}]}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:02:56.603987 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] validate_networks() for [('34a5cd18-91cb-4e78-aa92-8274c4753fdd', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:02:56.931514 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:02:56.931934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:02:56.932430 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:02:56.932834 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:02:56.933303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:02:56.942756 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:56.943212 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:56.944054 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:56.944493 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:56.960421 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Getting quotas for project 6c4cc9869de147a982a14d99fe61bced. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:02:56.964287 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Getting quotas for user 0d9aaa8277644382a0ac82f2f3d58db3 and project 6c4cc9869de147a982a14d99fe61bced. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:02:56.974780 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:02:56.977016 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:02:57.022096 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8e662334-0d35-4c16-8a97-c867c0c5e3c7 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.471745 May 10 20:02:57.022777 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 318/615] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:02:57.032654 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6dd3b7bb-7976-4abc-aecf-7d7cc4f5d936 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:57.033294 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6dd3b7bb-7976-4abc-aecf-7d7cc4f5d936 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:57.090279 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6dd3b7bb-7976-4abc-aecf-7d7cc4f5d936 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:57.098354 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6dd3b7bb-7976-4abc-aecf-7d7cc4f5d936 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1214 microversion: 2.1 time: 0.069401 May 10 20:02:57.099931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 298/616] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:57 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:02:57.377179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-14e6adc8-a004-40b8-b43f-9e825342beac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:57.378186 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-14e6adc8-a004-40b8-b43f-9e825342beac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:57.387398 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14e6adc8-a004-40b8-b43f-9e825342beac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:57.388099 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14e6adc8-a004-40b8-b43f-9e825342beac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:57.392333 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14e6adc8-a004-40b8-b43f-9e825342beac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:57.392944 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-14e6adc8-a004-40b8-b43f-9e825342beac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:57.545899 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-14e6adc8-a004-40b8-b43f-9e825342beac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:57.554760 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-14e6adc8-a004-40b8-b43f-9e825342beac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:57.556274 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-14e6adc8-a004-40b8-b43f-9e825342beac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:57.557430 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-14e6adc8-a004-40b8-b43f-9e825342beac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.184671 May 10 20:02:57.558097 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 319/617] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:57 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:58.119439 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-47c14900-fae5-42b3-88a3-528d277eceb8 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:58.120055 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-47c14900-fae5-42b3-88a3-528d277eceb8 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:58.127133 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-47c14900-fae5-42b3-88a3-528d277eceb8 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:58.127589 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-47c14900-fae5-42b3-88a3-528d277eceb8 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:58.128394 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-47c14900-fae5-42b3-88a3-528d277eceb8 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:58.128835 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-47c14900-fae5-42b3-88a3-528d277eceb8 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:58.190796 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-47c14900-fae5-42b3-88a3-528d277eceb8 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:58.198090 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-47c14900-fae5-42b3-88a3-528d277eceb8 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1266 microversion: 2.1 time: 0.082726 May 10 20:02:58.198688 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 299/618] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:58 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:02:58.576233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e450ffc5-005f-4376-b24a-3e42a61f0030 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:58.576840 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e450ffc5-005f-4376-b24a-3e42a61f0030 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:58.583983 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e450ffc5-005f-4376-b24a-3e42a61f0030 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:58.584426 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e450ffc5-005f-4376-b24a-3e42a61f0030 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:58.585183 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e450ffc5-005f-4376-b24a-3e42a61f0030 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:58.585640 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e450ffc5-005f-4376-b24a-3e42a61f0030 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:58.712314 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e450ffc5-005f-4376-b24a-3e42a61f0030 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:58.720500 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e450ffc5-005f-4376-b24a-3e42a61f0030 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:58.722008 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e450ffc5-005f-4376-b24a-3e42a61f0030 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:58.723244 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e450ffc5-005f-4376-b24a-3e42a61f0030 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.151011 May 10 20:02:58.723806 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 320/619] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:58 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:02:59.214740 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-42e98d6d-0705-4220-a8dd-5360651ec8ef tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:59.215351 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-42e98d6d-0705-4220-a8dd-5360651ec8ef tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:59.221575 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42e98d6d-0705-4220-a8dd-5360651ec8ef tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:59.222024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42e98d6d-0705-4220-a8dd-5360651ec8ef tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:59.222817 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42e98d6d-0705-4220-a8dd-5360651ec8ef tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:59.223255 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42e98d6d-0705-4220-a8dd-5360651ec8ef tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:59.284411 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-42e98d6d-0705-4220-a8dd-5360651ec8ef tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:59.292047 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-42e98d6d-0705-4220-a8dd-5360651ec8ef tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1266 microversion: 2.1 time: 0.081186 May 10 20:02:59.292609 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 300/620] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:02:59 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:02:59.742130 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-759fb6e6-eb25-4acc-88ec-f5a96345e48e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:02:59.742700 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-759fb6e6-eb25-4acc-88ec-f5a96345e48e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:02:59.748977 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-759fb6e6-eb25-4acc-88ec-f5a96345e48e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:59.749427 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-759fb6e6-eb25-4acc-88ec-f5a96345e48e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:59.750189 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-759fb6e6-eb25-4acc-88ec-f5a96345e48e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:02:59.750654 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-759fb6e6-eb25-4acc-88ec-f5a96345e48e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:02:59.877000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-759fb6e6-eb25-4acc-88ec-f5a96345e48e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:59.885117 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-759fb6e6-eb25-4acc-88ec-f5a96345e48e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:59.886652 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-759fb6e6-eb25-4acc-88ec-f5a96345e48e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:02:59.887844 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-759fb6e6-eb25-4acc-88ec-f5a96345e48e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.150016 May 10 20:02:59.888402 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 321/621] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:02:59 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:00.308688 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-afa08c84-3db7-49f0-959a-88c89dc56ab3 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:00.309312 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-afa08c84-3db7-49f0-959a-88c89dc56ab3 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:00.315725 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-afa08c84-3db7-49f0-959a-88c89dc56ab3 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:00.316182 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-afa08c84-3db7-49f0-959a-88c89dc56ab3 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:00.316954 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-afa08c84-3db7-49f0-959a-88c89dc56ab3 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:00.317395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-afa08c84-3db7-49f0-959a-88c89dc56ab3 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:00.377964 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-afa08c84-3db7-49f0-959a-88c89dc56ab3 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:00.385816 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-afa08c84-3db7-49f0-959a-88c89dc56ab3 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1266 microversion: 2.1 time: 0.081016 May 10 20:03:00.386404 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 301/622] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:00 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:00.906576 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3705dbf6-72ac-492b-8279-e5eaa8ebd9e5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:00.907126 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3705dbf6-72ac-492b-8279-e5eaa8ebd9e5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:00.914096 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3705dbf6-72ac-492b-8279-e5eaa8ebd9e5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:00.914585 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3705dbf6-72ac-492b-8279-e5eaa8ebd9e5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:00.915397 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3705dbf6-72ac-492b-8279-e5eaa8ebd9e5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:00.915857 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3705dbf6-72ac-492b-8279-e5eaa8ebd9e5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:01.048910 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3705dbf6-72ac-492b-8279-e5eaa8ebd9e5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:01.057747 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3705dbf6-72ac-492b-8279-e5eaa8ebd9e5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:01.059308 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3705dbf6-72ac-492b-8279-e5eaa8ebd9e5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:01.060476 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3705dbf6-72ac-492b-8279-e5eaa8ebd9e5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.157960 May 10 20:03:01.061044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 322/623] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:00 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:01.404252 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6e8a3c2f-558a-482d-9464-dc9a8cf5478b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:01.404865 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6e8a3c2f-558a-482d-9464-dc9a8cf5478b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:01.411221 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e8a3c2f-558a-482d-9464-dc9a8cf5478b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:01.412236 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e8a3c2f-558a-482d-9464-dc9a8cf5478b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:01.413007 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e8a3c2f-558a-482d-9464-dc9a8cf5478b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:01.413441 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e8a3c2f-558a-482d-9464-dc9a8cf5478b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:01.622490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6e8a3c2f-558a-482d-9464-dc9a8cf5478b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:01.631339 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6e8a3c2f-558a-482d-9464-dc9a8cf5478b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1314 microversion: 2.1 time: 0.230761 May 10 20:03:01.631900 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 302/624] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:01 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:01.766063 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-024d11b1-161b-4264-b3e8-9cceedb2821e req-2f98984f-a90e-4013-952d-ed378b6bdc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0782378-c040-4949-8ed6-a2433c147d35", "tag": "1d541046-ba8a-4df0-96d7-25c2703e4c3d"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:01.774614 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-024d11b1-161b-4264-b3e8-9cceedb2821e req-2f98984f-a90e-4013-952d-ed378b6bdc26 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:01.775069 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-024d11b1-161b-4264-b3e8-9cceedb2821e req-2f98984f-a90e-4013-952d-ed378b6bdc26 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:01.786786 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-024d11b1-161b-4264-b3e8-9cceedb2821e req-2f98984f-a90e-4013-952d-ed378b6bdc26 service nova] Creating event network-changed:1d541046-ba8a-4df0-96d7-25c2703e4c3d for instance b0782378-c040-4949-8ed6-a2433c147d35 on hv-cinder-84131 May 10 20:03:01.792251 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-024d11b1-161b-4264-b3e8-9cceedb2821e req-2f98984f-a90e-4013-952d-ed378b6bdc26 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029799 May 10 20:03:01.792860 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 323/625] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:03:02.079110 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-262f58b0-29cc-43dd-8b1c-68c27debce14 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:02.079809 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-262f58b0-29cc-43dd-8b1c-68c27debce14 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:02.086384 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-262f58b0-29cc-43dd-8b1c-68c27debce14 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:02.087043 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-262f58b0-29cc-43dd-8b1c-68c27debce14 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:02.088171 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-262f58b0-29cc-43dd-8b1c-68c27debce14 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:02.088613 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-262f58b0-29cc-43dd-8b1c-68c27debce14 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:02.319430 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-262f58b0-29cc-43dd-8b1c-68c27debce14 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:02.327882 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-262f58b0-29cc-43dd-8b1c-68c27debce14 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:02.329526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-262f58b0-29cc-43dd-8b1c-68c27debce14 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:02.330714 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-262f58b0-29cc-43dd-8b1c-68c27debce14 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.255378 May 10 20:03:02.331284 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 303/626] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:02 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:02.650290 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-561669dd-93ed-4b13-87ff-8dcd4205cbbf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:02.651081 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-561669dd-93ed-4b13-87ff-8dcd4205cbbf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:02.657443 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-561669dd-93ed-4b13-87ff-8dcd4205cbbf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:02.657890 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-561669dd-93ed-4b13-87ff-8dcd4205cbbf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:02.658718 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-561669dd-93ed-4b13-87ff-8dcd4205cbbf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:02.659163 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-561669dd-93ed-4b13-87ff-8dcd4205cbbf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:02.796285 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-561669dd-93ed-4b13-87ff-8dcd4205cbbf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:02.804211 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-561669dd-93ed-4b13-87ff-8dcd4205cbbf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1314 microversion: 2.1 time: 0.159325 May 10 20:03:02.804784 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 324/627] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:02 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:03.349183 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1b6326d8-f99f-4429-85ea-11b4930f1aaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:03.349693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1b6326d8-f99f-4429-85ea-11b4930f1aaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:03.356011 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b6326d8-f99f-4429-85ea-11b4930f1aaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:03.356463 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b6326d8-f99f-4429-85ea-11b4930f1aaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:03.357231 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b6326d8-f99f-4429-85ea-11b4930f1aaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:03.357725 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b6326d8-f99f-4429-85ea-11b4930f1aaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:03.485676 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1b6326d8-f99f-4429-85ea-11b4930f1aaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:03.494055 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1b6326d8-f99f-4429-85ea-11b4930f1aaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:03.495605 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1b6326d8-f99f-4429-85ea-11b4930f1aaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:03.496785 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1b6326d8-f99f-4429-85ea-11b4930f1aaa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.152055 May 10 20:03:03.497354 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 304/628] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:03 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:03.821593 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-675f4d62-e76f-4a66-8a85-38c99cd719bc tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:03.822207 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-675f4d62-e76f-4a66-8a85-38c99cd719bc tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:03.828542 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-675f4d62-e76f-4a66-8a85-38c99cd719bc tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:03.828992 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-675f4d62-e76f-4a66-8a85-38c99cd719bc tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:03.829747 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-675f4d62-e76f-4a66-8a85-38c99cd719bc tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:03.830182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-675f4d62-e76f-4a66-8a85-38c99cd719bc tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:03.954313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-675f4d62-e76f-4a66-8a85-38c99cd719bc tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:03.962041 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-675f4d62-e76f-4a66-8a85-38c99cd719bc tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1314 microversion: 2.1 time: 0.144879 May 10 20:03:03.962633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 325/629] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:03 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:04.515083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7d04467a-0110-487e-82c6-7358894d6d47 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:04.515725 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7d04467a-0110-487e-82c6-7358894d6d47 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:04.522580 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d04467a-0110-487e-82c6-7358894d6d47 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:04.523068 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d04467a-0110-487e-82c6-7358894d6d47 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:04.523861 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d04467a-0110-487e-82c6-7358894d6d47 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:04.524312 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d04467a-0110-487e-82c6-7358894d6d47 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:04.668907 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7d04467a-0110-487e-82c6-7358894d6d47 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:04.678127 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7d04467a-0110-487e-82c6-7358894d6d47 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:04.679816 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7d04467a-0110-487e-82c6-7358894d6d47 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:04.681097 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7d04467a-0110-487e-82c6-7358894d6d47 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.170100 May 10 20:03:04.681763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 305/630] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:04 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:04.964651 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-b54141d8-bf91-40f1-b231-d1cf4b74fbda req-e62a2b60-0003-4b6f-8dc6-97b257a16e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff53e635-0740-4f22-9c5b-8d8dd47571c5", "name": "network-vif-plugged", "status": "completed", "tag": "740fa7f3-ee5c-4744-9541-a814cc75f111"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:04.973263 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-b54141d8-bf91-40f1-b231-d1cf4b74fbda req-e62a2b60-0003-4b6f-8dc6-97b257a16e19 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:04.974480 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-b54141d8-bf91-40f1-b231-d1cf4b74fbda req-e62a2b60-0003-4b6f-8dc6-97b257a16e19 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:04.981731 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ae591565-6c75-42c6-a047-bfb954653707 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:04.982326 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ae591565-6c75-42c6-a047-bfb954653707 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:04.987943 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-b54141d8-bf91-40f1-b231-d1cf4b74fbda req-e62a2b60-0003-4b6f-8dc6-97b257a16e19 service nova] Creating event network-vif-plugged:740fa7f3-ee5c-4744-9541-a814cc75f111 for instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 on hv-cinder-84131 May 10 20:03:04.990504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae591565-6c75-42c6-a047-bfb954653707 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:04.991211 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae591565-6c75-42c6-a047-bfb954653707 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:04.992141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae591565-6c75-42c6-a047-bfb954653707 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:04.992603 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae591565-6c75-42c6-a047-bfb954653707 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:04.993347 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-b54141d8-bf91-40f1-b231-d1cf4b74fbda req-e62a2b60-0003-4b6f-8dc6-97b257a16e19 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032669 May 10 20:03:04.994130 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 326/631] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:03:05.131595 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ae591565-6c75-42c6-a047-bfb954653707 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:05.138789 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ae591565-6c75-42c6-a047-bfb954653707 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1314 microversion: 2.1 time: 0.163154 May 10 20:03:05.139361 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 306/632] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:04 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:05.701776 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-27843e92-1fc5-41d1-a3e5-acbc0f9b7a35 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:05.702682 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-27843e92-1fc5-41d1-a3e5-acbc0f9b7a35 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:05.710108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27843e92-1fc5-41d1-a3e5-acbc0f9b7a35 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:05.710588 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27843e92-1fc5-41d1-a3e5-acbc0f9b7a35 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:05.711379 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27843e92-1fc5-41d1-a3e5-acbc0f9b7a35 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:05.711800 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27843e92-1fc5-41d1-a3e5-acbc0f9b7a35 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:05.854914 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-27843e92-1fc5-41d1-a3e5-acbc0f9b7a35 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:05.863305 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-27843e92-1fc5-41d1-a3e5-acbc0f9b7a35 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:05.865055 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-27843e92-1fc5-41d1-a3e5-acbc0f9b7a35 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:05.866605 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-27843e92-1fc5-41d1-a3e5-acbc0f9b7a35 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.170258 May 10 20:03:05.867203 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 327/633] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:05 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:06.155827 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2dbaf453-ed31-408f-978a-9b5c3cf0288e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:06.156663 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2dbaf453-ed31-408f-978a-9b5c3cf0288e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:06.162867 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2dbaf453-ed31-408f-978a-9b5c3cf0288e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:06.163317 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2dbaf453-ed31-408f-978a-9b5c3cf0288e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:06.164078 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2dbaf453-ed31-408f-978a-9b5c3cf0288e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:06.164513 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2dbaf453-ed31-408f-978a-9b5c3cf0288e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:06.305807 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2dbaf453-ed31-408f-978a-9b5c3cf0288e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:06.313423 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2dbaf453-ed31-408f-978a-9b5c3cf0288e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1314 microversion: 2.1 time: 0.161377 May 10 20:03:06.313998 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 307/634] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:06 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:06.884569 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bfa264e9-fa9b-4db1-b557-f139ae8b8f0a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:06.885184 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bfa264e9-fa9b-4db1-b557-f139ae8b8f0a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:06.891169 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bfa264e9-fa9b-4db1-b557-f139ae8b8f0a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:06.891683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bfa264e9-fa9b-4db1-b557-f139ae8b8f0a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:06.892452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bfa264e9-fa9b-4db1-b557-f139ae8b8f0a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:06.892920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bfa264e9-fa9b-4db1-b557-f139ae8b8f0a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:07.018965 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bfa264e9-fa9b-4db1-b557-f139ae8b8f0a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:07.021473 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-6c08b4db-00f8-43f2-bf9a-aab18906e65d req-320032e1-3af3-4e32-9ce7-8f1bfb6d483f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0782378-c040-4949-8ed6-a2433c147d35", "name": "network-vif-plugged", "status": "completed", "tag": "1d541046-ba8a-4df0-96d7-25c2703e4c3d"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:07.029774 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-6c08b4db-00f8-43f2-bf9a-aab18906e65d req-320032e1-3af3-4e32-9ce7-8f1bfb6d483f service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:07.030007 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bfa264e9-fa9b-4db1-b557-f139ae8b8f0a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:07.030274 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-6c08b4db-00f8-43f2-bf9a-aab18906e65d req-320032e1-3af3-4e32-9ce7-8f1bfb6d483f service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:07.031426 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bfa264e9-fa9b-4db1-b557-f139ae8b8f0a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:07.032618 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bfa264e9-fa9b-4db1-b557-f139ae8b8f0a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.152290 May 10 20:03:07.033521 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 328/635] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:06 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:07.042052 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-6c08b4db-00f8-43f2-bf9a-aab18906e65d req-320032e1-3af3-4e32-9ce7-8f1bfb6d483f service nova] Creating event network-vif-plugged:1d541046-ba8a-4df0-96d7-25c2703e4c3d for instance b0782378-c040-4949-8ed6-a2433c147d35 on hv-cinder-84131 May 10 20:03:07.047026 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-6c08b4db-00f8-43f2-bf9a-aab18906e65d req-320032e1-3af3-4e32-9ce7-8f1bfb6d483f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029188 May 10 20:03:07.047620 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 308/636] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:03:07.330395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a8d6bf4d-6349-4f11-bcc8-4be610da23a1 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:07.331052 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a8d6bf4d-6349-4f11-bcc8-4be610da23a1 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:07.337727 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a8d6bf4d-6349-4f11-bcc8-4be610da23a1 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:07.338365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a8d6bf4d-6349-4f11-bcc8-4be610da23a1 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:07.339166 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a8d6bf4d-6349-4f11-bcc8-4be610da23a1 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:07.339792 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a8d6bf4d-6349-4f11-bcc8-4be610da23a1 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:07.518482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a8d6bf4d-6349-4f11-bcc8-4be610da23a1 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:07.530745 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a8d6bf4d-6349-4f11-bcc8-4be610da23a1 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1314 microversion: 2.1 time: 0.204061 May 10 20:03:07.531352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 329/637] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:07 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:08.053727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ecd412f2-af8c-4dc3-8ebe-9f462fa1dbaf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:08.054495 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ecd412f2-af8c-4dc3-8ebe-9f462fa1dbaf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:08.061150 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecd412f2-af8c-4dc3-8ebe-9f462fa1dbaf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:08.061607 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecd412f2-af8c-4dc3-8ebe-9f462fa1dbaf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:08.062398 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecd412f2-af8c-4dc3-8ebe-9f462fa1dbaf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:08.062880 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecd412f2-af8c-4dc3-8ebe-9f462fa1dbaf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:08.197211 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ecd412f2-af8c-4dc3-8ebe-9f462fa1dbaf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:08.207475 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ecd412f2-af8c-4dc3-8ebe-9f462fa1dbaf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:08.209016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ecd412f2-af8c-4dc3-8ebe-9f462fa1dbaf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:08.210185 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ecd412f2-af8c-4dc3-8ebe-9f462fa1dbaf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1808 microversion: 2.20 time: 0.161815 May 10 20:03:08.215028 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 309/638] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:08 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:08.549462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8a828737-ee12-41ae-8ff5-d8e3896f50ed tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:08.550184 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8a828737-ee12-41ae-8ff5-d8e3896f50ed tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:08.557916 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a828737-ee12-41ae-8ff5-d8e3896f50ed tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:08.558365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a828737-ee12-41ae-8ff5-d8e3896f50ed tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:08.559183 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a828737-ee12-41ae-8ff5-d8e3896f50ed tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:08.559615 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a828737-ee12-41ae-8ff5-d8e3896f50ed tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:08.682404 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8a828737-ee12-41ae-8ff5-d8e3896f50ed tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:08.689630 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8a828737-ee12-41ae-8ff5-d8e3896f50ed tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1314 microversion: 2.1 time: 0.144824 May 10 20:03:08.690196 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 330/639] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:08 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:09.229487 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b4876f59-c6b1-469c-8a0c-54e2dd744216 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:09.230099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b4876f59-c6b1-469c-8a0c-54e2dd744216 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:09.236449 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4876f59-c6b1-469c-8a0c-54e2dd744216 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:09.236906 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4876f59-c6b1-469c-8a0c-54e2dd744216 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:09.237669 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4876f59-c6b1-469c-8a0c-54e2dd744216 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:09.238104 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4876f59-c6b1-469c-8a0c-54e2dd744216 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:09.367767 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b4876f59-c6b1-469c-8a0c-54e2dd744216 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:09.377268 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b4876f59-c6b1-469c-8a0c-54e2dd744216 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:09.378975 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b4876f59-c6b1-469c-8a0c-54e2dd744216 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:09.380948 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b4876f59-c6b1-469c-8a0c-54e2dd744216 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1795 microversion: 2.20 time: 0.155448 May 10 20:03:09.382720 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 310/640] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:09 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1795 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:09.706566 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-454272d0-ade3-4a8a-ad52-cd5e88f0ce1b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:09.707173 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-454272d0-ade3-4a8a-ad52-cd5e88f0ce1b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:09.713489 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-454272d0-ade3-4a8a-ad52-cd5e88f0ce1b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:09.714032 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-454272d0-ade3-4a8a-ad52-cd5e88f0ce1b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:09.714825 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-454272d0-ade3-4a8a-ad52-cd5e88f0ce1b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:09.715257 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-454272d0-ade3-4a8a-ad52-cd5e88f0ce1b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:09.842674 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-454272d0-ade3-4a8a-ad52-cd5e88f0ce1b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:09.850364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-454272d0-ade3-4a8a-ad52-cd5e88f0ce1b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1497 microversion: 2.1 time: 0.147750 May 10 20:03:09.850966 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 331/641] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:09 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:10.282252 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b770b044-f28a-4819-a2d3-6f9f11109fd4 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:10.282804 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b770b044-f28a-4819-a2d3-6f9f11109fd4 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:10.289230 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b770b044-f28a-4819-a2d3-6f9f11109fd4 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:10.289677 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b770b044-f28a-4819-a2d3-6f9f11109fd4 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:10.290451 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b770b044-f28a-4819-a2d3-6f9f11109fd4 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:10.290919 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b770b044-f28a-4819-a2d3-6f9f11109fd4 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:10.315686 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b770b044-f28a-4819-a2d3-6f9f11109fd4 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:03:10.386026 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b770b044-f28a-4819-a2d3-6f9f11109fd4 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 204 len: 0 microversion: 2.1 time: 0.107285 May 10 20:03:10.386648 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 311/642] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:03:10 2022] DELETE /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:03:10.395063 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-be378524-51f8-4e15-878f-4b79c1861430 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:10.395710 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-be378524-51f8-4e15-878f-4b79c1861430 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:10.401527 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be378524-51f8-4e15-878f-4b79c1861430 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:10.401977 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be378524-51f8-4e15-878f-4b79c1861430 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:10.402777 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be378524-51f8-4e15-878f-4b79c1861430 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:10.403213 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be378524-51f8-4e15-878f-4b79c1861430 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:10.534770 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-be378524-51f8-4e15-878f-4b79c1861430 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:10.542575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-be378524-51f8-4e15-878f-4b79c1861430 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1503 microversion: 2.1 time: 0.151561 May 10 20:03:10.543146 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 332/643] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:10 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:11.560331 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-90f570b2-883c-465a-b3e6-2aeb2439ddcf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:11.561031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-90f570b2-883c-465a-b3e6-2aeb2439ddcf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:11.567239 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-90f570b2-883c-465a-b3e6-2aeb2439ddcf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:11.567684 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-90f570b2-883c-465a-b3e6-2aeb2439ddcf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:11.568951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-90f570b2-883c-465a-b3e6-2aeb2439ddcf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:11.569458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-90f570b2-883c-465a-b3e6-2aeb2439ddcf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:11.699093 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-90f570b2-883c-465a-b3e6-2aeb2439ddcf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:11.706429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-90f570b2-883c-465a-b3e6-2aeb2439ddcf tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1503 microversion: 2.1 time: 0.150247 May 10 20:03:11.707027 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 312/644] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:11 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:12.295799 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-0ab01ae7-2961-4f0b-83fa-82072fa09c1c req-5e66f5a0-efcc-4768-aaa8-99c1739ea2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0782378-c040-4949-8ed6-a2433c147d35", "name": "network-vif-deleted", "tag": "1d541046-ba8a-4df0-96d7-25c2703e4c3d"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:12.306529 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-0ab01ae7-2961-4f0b-83fa-82072fa09c1c req-5e66f5a0-efcc-4768-aaa8-99c1739ea2de service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:12.306983 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-0ab01ae7-2961-4f0b-83fa-82072fa09c1c req-5e66f5a0-efcc-4768-aaa8-99c1739ea2de service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:12.318897 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-0ab01ae7-2961-4f0b-83fa-82072fa09c1c req-5e66f5a0-efcc-4768-aaa8-99c1739ea2de service nova] Creating event network-vif-deleted:1d541046-ba8a-4df0-96d7-25c2703e4c3d for instance b0782378-c040-4949-8ed6-a2433c147d35 on hv-cinder-84131 May 10 20:03:12.324179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-0ab01ae7-2961-4f0b-83fa-82072fa09c1c req-5e66f5a0-efcc-4768-aaa8-99c1739ea2de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032975 May 10 20:03:12.324826 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 333/645] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:03:12.723792 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-41320e1d-cc02-45ef-9d6a-7c3acd82200b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:12.724465 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-41320e1d-cc02-45ef-9d6a-7c3acd82200b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:12.733082 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41320e1d-cc02-45ef-9d6a-7c3acd82200b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:12.733538 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41320e1d-cc02-45ef-9d6a-7c3acd82200b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:12.734682 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41320e1d-cc02-45ef-9d6a-7c3acd82200b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:12.735345 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41320e1d-cc02-45ef-9d6a-7c3acd82200b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:12.771082 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41320e1d-cc02-45ef-9d6a-7c3acd82200b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:12.771609 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41320e1d-cc02-45ef-9d6a-7c3acd82200b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:12.772552 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-41320e1d-cc02-45ef-9d6a-7c3acd82200b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lazy-loading 'fault' on Instance uuid b0782378-c040-4949-8ed6-a2433c147d35 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:03:12.814640 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-41320e1d-cc02-45ef-9d6a-7c3acd82200b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:12.823478 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-41320e1d-cc02-45ef-9d6a-7c3acd82200b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 200 len: 1304 microversion: 2.1 time: 0.103549 May 10 20:03:12.824106 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 313/646] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:12 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:13.842097 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2b160212-be08-44a9-a3f4-962b0c249f10 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:13.842816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2b160212-be08-44a9-a3f4-962b0c249f10 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: b0782378-c040-4949-8ed6-a2433c147d35] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:13.848903 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b160212-be08-44a9-a3f4-962b0c249f10 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:13.849372 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b160212-be08-44a9-a3f4-962b0c249f10 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:13.850668 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b160212-be08-44a9-a3f4-962b0c249f10 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:13.851108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b160212-be08-44a9-a3f4-962b0c249f10 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:13.863993 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-2b160212-be08-44a9-a3f4-962b0c249f10 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] HTTP exception thrown: Instance b0782378-c040-4949-8ed6-a2433c147d35 could not be found. May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2b160212-be08-44a9-a3f4-962b0c249f10 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Request method failure captured: May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 HTTP/1.1 May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesTu6tU0lfmFqTRXA_sBIIftPlmSVZjgAdTkuTL82BLgzzMUyBn8A_-xB1WrCdL6mFNw0zbViwkSmZi2jsvv66v0yCmWoKRl5HGkrFfoqq7Tsm5WtENVZSsPSdVmBpmdT_111FGSL2MTGcbIr2FffKoG9WmXwir4CzFpCv7Cm-qg2bU May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 6c4cc9869de147a982a14d99fe61bced May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-VolumesActionsTest-947990197 May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:03:13.866590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c4cc9869de147a982a14d99fe61bced"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c4cc9869de147a982a14d99fe61bced", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c4cc9869de147a982a14d99fe61bced"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c4cc9869de147a982a14d99fe61bced"}]}] May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-VolumesActionsTest-947990197 May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 6c4cc9869de147a982a14d99fe61bced May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-VolumesActionsTest-947990197 May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-VolumesActionsTest-947990197-project May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 0d9aaa8277644382a0ac82f2f3d58db3 May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-VolumesActionsTest-947990197-project May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance b0782378-c040-4949-8ed6-a2433c147d35 could not be found. May 10 20:03:13.868022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': 'b0782378-c040-4949-8ed6-a2433c147d35'} May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0782378-c040-4949-8ed6-a2433c147d35 could not be found. May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:03:13.868822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0782378-c040-4949-8ed6-a2433c147d35 could not be found. May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0782378-c040-4949-8ed6-a2433c147d35 could not be found. May 10 20:03:13.870352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:03:13.871576 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2b160212-be08-44a9-a3f4-962b0c249f10 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Returning 404 to user: Instance b0782378-c040-4949-8ed6-a2433c147d35 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:03:13.871576 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2b160212-be08-44a9-a3f4-962b0c249f10 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35" status: 404 len: 111 microversion: 2.1 time: 0.030538 May 10 20:03:13.871576 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 334/647] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:13 2022] GET /compute/v2.1/servers/b0782378-c040-4949-8ed6-a2433c147d35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:03:13.916129 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-143158704", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "networks": [{"uuid": "34a5cd18-91cb-4e78-aa92-8274c4753fdd"}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:13.969830 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] validate_networks() for [('34a5cd18-91cb-4e78-aa92-8274c4753fdd', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:03:14.313701 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:03:14.314147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:03:14.314651 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:03:14.315054 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:03:14.315459 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:03:14.324499 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:14.324940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:14.325732 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:14.326161 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:14.342786 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Getting quotas for project 6c4cc9869de147a982a14d99fe61bced. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:03:14.346509 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Getting quotas for user 0d9aaa8277644382a0ac82f2f3d58db3 and project 6c4cc9869de147a982a14d99fe61bced. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:03:14.356947 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:03:14.359111 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:03:14.409268 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-76eddbee-9010-4895-aa77-0e5fc32b62eb tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497452 May 10 20:03:14.415830 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 314/648] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:03:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:03:14.421823 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7c5be594-ef60-4e32-bef1-71e170f098f0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:14.422575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7c5be594-ef60-4e32-bef1-71e170f098f0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:14.474872 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7c5be594-ef60-4e32-bef1-71e170f098f0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:14.481485 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7c5be594-ef60-4e32-bef1-71e170f098f0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1213 microversion: 2.1 time: 0.064085 May 10 20:03:14.482047 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 335/649] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:14 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:15.497400 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9fad3832-6206-45f6-b4f9-3ed61fbdbb69 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:15.498058 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9fad3832-6206-45f6-b4f9-3ed61fbdbb69 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:15.505277 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9fad3832-6206-45f6-b4f9-3ed61fbdbb69 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:15.505765 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9fad3832-6206-45f6-b4f9-3ed61fbdbb69 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:15.507118 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9fad3832-6206-45f6-b4f9-3ed61fbdbb69 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:15.507568 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9fad3832-6206-45f6-b4f9-3ed61fbdbb69 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:15.584715 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9fad3832-6206-45f6-b4f9-3ed61fbdbb69 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:15.592747 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9fad3832-6206-45f6-b4f9-3ed61fbdbb69 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1271 microversion: 2.1 time: 0.099041 May 10 20:03:15.593359 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 315/650] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:15 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:16.610745 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c7f7e76e-f0f0-4157-8710-5c000649477b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:16.611595 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c7f7e76e-f0f0-4157-8710-5c000649477b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:16.619724 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7f7e76e-f0f0-4157-8710-5c000649477b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:16.620264 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7f7e76e-f0f0-4157-8710-5c000649477b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:16.621176 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7f7e76e-f0f0-4157-8710-5c000649477b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:16.621767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7f7e76e-f0f0-4157-8710-5c000649477b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:16.751570 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c7f7e76e-f0f0-4157-8710-5c000649477b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:16.759804 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c7f7e76e-f0f0-4157-8710-5c000649477b tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1313 microversion: 2.1 time: 0.153163 May 10 20:03:16.768945 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 336/651] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:16 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:16.801867 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-920cd9e5-13b0-46b1-9ae4-16ca109710bc req-e043d4be-c7fd-4b4d-a2de-2875277a9571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b43321-cf5f-449b-a37c-d659920cc469", "tag": "d87b8d6e-f14a-44db-8c14-5b25bf00e05d"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:16.811570 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-920cd9e5-13b0-46b1-9ae4-16ca109710bc req-e043d4be-c7fd-4b4d-a2de-2875277a9571 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:16.812057 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-920cd9e5-13b0-46b1-9ae4-16ca109710bc req-e043d4be-c7fd-4b4d-a2de-2875277a9571 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:16.823757 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-920cd9e5-13b0-46b1-9ae4-16ca109710bc req-e043d4be-c7fd-4b4d-a2de-2875277a9571 service nova] Creating event network-changed:d87b8d6e-f14a-44db-8c14-5b25bf00e05d for instance 81b43321-cf5f-449b-a37c-d659920cc469 on hv-cinder-84131 May 10 20:03:16.828406 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-920cd9e5-13b0-46b1-9ae4-16ca109710bc req-e043d4be-c7fd-4b4d-a2de-2875277a9571 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031012 May 10 20:03:16.829018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 316/652] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:03:17.777067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-832bc552-bd75-4914-aa17-cc86d5bb0371 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:17.777679 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-832bc552-bd75-4914-aa17-cc86d5bb0371 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:17.783992 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-832bc552-bd75-4914-aa17-cc86d5bb0371 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:17.784445 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-832bc552-bd75-4914-aa17-cc86d5bb0371 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:17.785214 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-832bc552-bd75-4914-aa17-cc86d5bb0371 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:17.785651 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-832bc552-bd75-4914-aa17-cc86d5bb0371 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:17.915173 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-832bc552-bd75-4914-aa17-cc86d5bb0371 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:17.922263 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-832bc552-bd75-4914-aa17-cc86d5bb0371 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1313 microversion: 2.1 time: 0.149107 May 10 20:03:17.922868 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 337/653] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:17 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:18.939398 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-85a3de93-270f-45f9-a974-2ca15ecc8764 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:18.940030 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-85a3de93-270f-45f9-a974-2ca15ecc8764 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:18.946668 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-85a3de93-270f-45f9-a974-2ca15ecc8764 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:18.947122 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-85a3de93-270f-45f9-a974-2ca15ecc8764 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:18.947886 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-85a3de93-270f-45f9-a974-2ca15ecc8764 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:18.948322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-85a3de93-270f-45f9-a974-2ca15ecc8764 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:19.074589 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-85a3de93-270f-45f9-a974-2ca15ecc8764 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:19.081744 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-85a3de93-270f-45f9-a974-2ca15ecc8764 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1313 microversion: 2.1 time: 0.147063 May 10 20:03:19.082327 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 317/654] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:18 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:20.099050 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-81ef3a77-9ea9-4ede-b439-a7c3298601d0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:20.100312 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-81ef3a77-9ea9-4ede-b439-a7c3298601d0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:20.106808 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81ef3a77-9ea9-4ede-b439-a7c3298601d0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:20.107266 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81ef3a77-9ea9-4ede-b439-a7c3298601d0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:20.108049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81ef3a77-9ea9-4ede-b439-a7c3298601d0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:20.108490 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81ef3a77-9ea9-4ede-b439-a7c3298601d0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:20.233326 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-81ef3a77-9ea9-4ede-b439-a7c3298601d0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:20.240841 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-81ef3a77-9ea9-4ede-b439-a7c3298601d0 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1313 microversion: 2.1 time: 0.145416 May 10 20:03:20.241454 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 338/655] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:20 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:20.736943 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-7eee38e4-be15-42a8-aebd-2286a923c4b0 req-c1fce052-229f-4889-bced-1d724f7de92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b43321-cf5f-449b-a37c-d659920cc469", "name": "network-vif-plugged", "status": "completed", "tag": "d87b8d6e-f14a-44db-8c14-5b25bf00e05d"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:20.746736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-7eee38e4-be15-42a8-aebd-2286a923c4b0 req-c1fce052-229f-4889-bced-1d724f7de92c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:20.747700 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-7eee38e4-be15-42a8-aebd-2286a923c4b0 req-c1fce052-229f-4889-bced-1d724f7de92c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:20.759497 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-7eee38e4-be15-42a8-aebd-2286a923c4b0 req-c1fce052-229f-4889-bced-1d724f7de92c service nova] Creating event network-vif-plugged:d87b8d6e-f14a-44db-8c14-5b25bf00e05d for instance 81b43321-cf5f-449b-a37c-d659920cc469 on hv-cinder-84131 May 10 20:03:20.764315 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-7eee38e4-be15-42a8-aebd-2286a923c4b0 req-c1fce052-229f-4889-bced-1d724f7de92c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031080 May 10 20:03:20.764893 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 318/656] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:03:21.260878 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-03fa33ae-f6f7-4664-bdf6-c39cc32709ce tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:21.262276 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-03fa33ae-f6f7-4664-bdf6-c39cc32709ce tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:21.269815 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-03fa33ae-f6f7-4664-bdf6-c39cc32709ce tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:21.270270 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-03fa33ae-f6f7-4664-bdf6-c39cc32709ce tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:21.271713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-03fa33ae-f6f7-4664-bdf6-c39cc32709ce tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:21.272156 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-03fa33ae-f6f7-4664-bdf6-c39cc32709ce tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:21.405719 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-03fa33ae-f6f7-4664-bdf6-c39cc32709ce tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:21.414633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-03fa33ae-f6f7-4664-bdf6-c39cc32709ce tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1313 microversion: 2.1 time: 0.161006 May 10 20:03:21.415218 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 339/657] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:21 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:22.433745 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3801ac03-b60d-4c04-98f4-9853a3ff6b66 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:22.434482 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3801ac03-b60d-4c04-98f4-9853a3ff6b66 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:22.441000 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3801ac03-b60d-4c04-98f4-9853a3ff6b66 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:22.441453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3801ac03-b60d-4c04-98f4-9853a3ff6b66 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:22.442220 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3801ac03-b60d-4c04-98f4-9853a3ff6b66 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:22.442699 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3801ac03-b60d-4c04-98f4-9853a3ff6b66 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:22.573024 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3801ac03-b60d-4c04-98f4-9853a3ff6b66 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:22.580289 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3801ac03-b60d-4c04-98f4-9853a3ff6b66 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1313 microversion: 2.1 time: 0.150971 May 10 20:03:22.580864 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 319/658] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:22 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:23.597038 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-aac6a916-25de-4395-8f0f-fe0f62d5f60a tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:23.597679 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-aac6a916-25de-4395-8f0f-fe0f62d5f60a tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:23.604097 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aac6a916-25de-4395-8f0f-fe0f62d5f60a tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:23.604556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aac6a916-25de-4395-8f0f-fe0f62d5f60a tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:23.605356 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aac6a916-25de-4395-8f0f-fe0f62d5f60a tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:23.605799 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aac6a916-25de-4395-8f0f-fe0f62d5f60a tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:23.730819 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-aac6a916-25de-4395-8f0f-fe0f62d5f60a tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:23.738147 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-aac6a916-25de-4395-8f0f-fe0f62d5f60a tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1496 microversion: 2.1 time: 0.144941 May 10 20:03:23.738768 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 340/659] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:23 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1496 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:24.151388 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7ce36df9-e274-448f-bc43-cea27acf738e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:24.151913 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7ce36df9-e274-448f-bc43-cea27acf738e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:24.158021 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ce36df9-e274-448f-bc43-cea27acf738e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:24.158494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ce36df9-e274-448f-bc43-cea27acf738e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:24.159264 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ce36df9-e274-448f-bc43-cea27acf738e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:24.159705 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ce36df9-e274-448f-bc43-cea27acf738e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:24.185702 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7ce36df9-e274-448f-bc43-cea27acf738e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:03:24.261372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7ce36df9-e274-448f-bc43-cea27acf738e tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "DELETE /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 204 len: 0 microversion: 2.1 time: 0.114095 May 10 20:03:24.261996 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 320/660] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:03:24 2022] DELETE /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:03:24.270394 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e633d52f-325f-49fe-85a8-8de5e1e84c99 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:24.271745 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e633d52f-325f-49fe-85a8-8de5e1e84c99 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:24.277598 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e633d52f-325f-49fe-85a8-8de5e1e84c99 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:24.278124 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e633d52f-325f-49fe-85a8-8de5e1e84c99 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:24.279040 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e633d52f-325f-49fe-85a8-8de5e1e84c99 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:24.279701 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e633d52f-325f-49fe-85a8-8de5e1e84c99 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:24.410074 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e633d52f-325f-49fe-85a8-8de5e1e84c99 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:24.418233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e633d52f-325f-49fe-85a8-8de5e1e84c99 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1502 microversion: 2.1 time: 0.151902 May 10 20:03:24.418832 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 341/661] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:24 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:25.435737 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b4662c0d-f59f-4a30-a913-8c7d1bc4ddfd tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:25.436451 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b4662c0d-f59f-4a30-a913-8c7d1bc4ddfd tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:25.442333 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4662c0d-f59f-4a30-a913-8c7d1bc4ddfd tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:25.446028 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4662c0d-f59f-4a30-a913-8c7d1bc4ddfd tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:25.446028 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4662c0d-f59f-4a30-a913-8c7d1bc4ddfd tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:25.446028 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4662c0d-f59f-4a30-a913-8c7d1bc4ddfd tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:25.581490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b4662c0d-f59f-4a30-a913-8c7d1bc4ddfd tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:25.589531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b4662c0d-f59f-4a30-a913-8c7d1bc4ddfd tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1502 microversion: 2.1 time: 0.158161 May 10 20:03:25.590127 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 321/662] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:25 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:26.159863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-cf5bb62c-db39-4f2b-94c5-f8720800bb7a req-95c50599-c869-437f-83fc-53402582ab4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b43321-cf5f-449b-a37c-d659920cc469", "name": "network-vif-deleted", "tag": "d87b8d6e-f14a-44db-8c14-5b25bf00e05d"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:26.168263 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-cf5bb62c-db39-4f2b-94c5-f8720800bb7a req-95c50599-c869-437f-83fc-53402582ab4d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:26.168708 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-cf5bb62c-db39-4f2b-94c5-f8720800bb7a req-95c50599-c869-437f-83fc-53402582ab4d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:26.180958 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-cf5bb62c-db39-4f2b-94c5-f8720800bb7a req-95c50599-c869-437f-83fc-53402582ab4d service nova] Creating event network-vif-deleted:d87b8d6e-f14a-44db-8c14-5b25bf00e05d for instance 81b43321-cf5f-449b-a37c-d659920cc469 on hv-cinder-84131 May 10 20:03:26.186352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-cf5bb62c-db39-4f2b-94c5-f8720800bb7a req-95c50599-c869-437f-83fc-53402582ab4d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030076 May 10 20:03:26.186955 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 342/663] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:03:26.606299 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b9e447cd-ab30-4884-a603-2a0301b49992 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:26.606942 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b9e447cd-ab30-4884-a603-2a0301b49992 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:26.613690 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b9e447cd-ab30-4884-a603-2a0301b49992 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:26.614143 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b9e447cd-ab30-4884-a603-2a0301b49992 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:26.615816 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b9e447cd-ab30-4884-a603-2a0301b49992 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:26.616259 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b9e447cd-ab30-4884-a603-2a0301b49992 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:26.655549 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b9e447cd-ab30-4884-a603-2a0301b49992 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:26.655999 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b9e447cd-ab30-4884-a603-2a0301b49992 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:26.656446 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-b9e447cd-ab30-4884-a603-2a0301b49992 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lazy-loading 'fault' on Instance uuid 81b43321-cf5f-449b-a37c-d659920cc469 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:03:26.700531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b9e447cd-ab30-4884-a603-2a0301b49992 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9aaa8277644382a0ac82f2f3d58db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4cc9869de147a982a14d99fe61bced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:26.707305 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b9e447cd-ab30-4884-a603-2a0301b49992 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 200 len: 1303 microversion: 2.1 time: 0.104813 May 10 20:03:26.707881 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 322/664] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:26 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:27.725782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cf4af5a3-4261-4f43-9b90-771201299f23 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:27.726506 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cf4af5a3-4261-4f43-9b90-771201299f23 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] [instance: 81b43321-cf5f-449b-a37c-d659920cc469] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:27.732674 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf4af5a3-4261-4f43-9b90-771201299f23 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:27.733151 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf4af5a3-4261-4f43-9b90-771201299f23 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:27.733918 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf4af5a3-4261-4f43-9b90-771201299f23 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:27.734355 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf4af5a3-4261-4f43-9b90-771201299f23 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:27.748341 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-cf4af5a3-4261-4f43-9b90-771201299f23 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] HTTP exception thrown: Instance 81b43321-cf5f-449b-a37c-d659920cc469 could not be found. May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cf4af5a3-4261-4f43-9b90-771201299f23 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Request method failure captured: May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 HTTP/1.1 May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesTu6tU0lfmFqTRXA_sBIIftPlmSVZjgAdTkuTL82BLgzzMUyBn8A_-xB1WrCdL6mFNw0zbViwkSmZi2jsvv66v0yCmWoKRl5HGkrFfoqq7Tsm5WtENVZSsPSdVmBpmdT_111FGSL2MTGcbIr2FffKoG9WmXwir4CzFpCv7Cm-qg2bU May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 6c4cc9869de147a982a14d99fe61bced May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-VolumesActionsTest-947990197 May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:03:27.750067 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c4cc9869de147a982a14d99fe61bced"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c4cc9869de147a982a14d99fe61bced", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c4cc9869de147a982a14d99fe61bced"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c4cc9869de147a982a14d99fe61bced"}]}] May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-VolumesActionsTest-947990197 May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 6c4cc9869de147a982a14d99fe61bced May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-VolumesActionsTest-947990197 May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-VolumesActionsTest-947990197-project May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 0d9aaa8277644382a0ac82f2f3d58db3 May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-VolumesActionsTest-947990197-project May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 81b43321-cf5f-449b-a37c-d659920cc469 could not be found. May 10 20:03:27.751669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '81b43321-cf5f-449b-a37c-d659920cc469'} May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b43321-cf5f-449b-a37c-d659920cc469 could not be found. May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:03:27.752482 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b43321-cf5f-449b-a37c-d659920cc469 could not be found. May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b43321-cf5f-449b-a37c-d659920cc469 could not be found. May 10 20:03:27.753767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:03:27.754933 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cf4af5a3-4261-4f43-9b90-771201299f23 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] Returning 404 to user: Instance 81b43321-cf5f-449b-a37c-d659920cc469 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:03:27.754933 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cf4af5a3-4261-4f43-9b90-771201299f23 tempest-VolumesActionsTest-947990197 tempest-VolumesActionsTest-947990197-project] 10.222.0.57 "GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469" status: 404 len: 111 microversion: 2.1 time: 0.030880 May 10 20:03:27.754933 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 343/665] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:27 2022] GET /compute/v2.1/servers/81b43321-cf5f-449b-a37c-d659920cc469 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:03:30.407653 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:03:30.408220 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Tue May 10 20:03:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:03:32.032268 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-822880591", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "networks": [{"uuid": "6c1a4f20-babc-42e5-978f-c3e4365331a8"}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:32.080999 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] validate_networks() for [('6c1a4f20-babc-42e5-978f-c3e4365331a8', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:03:32.424594 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:03:32.425092 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:03:32.425639 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:03:32.426441 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:03:32.426952 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:03:32.436029 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:32.436562 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:32.437437 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:32.437962 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:32.456481 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Getting quotas for project 143c50428b1247a9ac6f60a26bfbaa80. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:03:32.460435 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Getting quotas for user 4ed6cd976b1442718a7b307588b57431 and project 143c50428b1247a9ac6f60a26bfbaa80. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:03:32.471546 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:03:32.473822 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:03:32.529699 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8453a81c-496b-470e-9bd5-8dd1a1c4e054 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501079 May 10 20:03:32.531570 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 323/666] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:03:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:03:32.544155 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fdbadde5-209a-41bf-9672-bf829f84ef1a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:32.545404 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fdbadde5-209a-41bf-9672-bf829f84ef1a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:32.610791 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fdbadde5-209a-41bf-9672-bf829f84ef1a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:32.618104 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fdbadde5-209a-41bf-9672-bf829f84ef1a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1218 microversion: 2.1 time: 0.079363 May 10 20:03:32.618908 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 344/667] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:32 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:03:33.640865 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ecfd80f5-2a18-4a27-ba7e-93b8f9c2e494 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:33.641751 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ecfd80f5-2a18-4a27-ba7e-93b8f9c2e494 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:33.664603 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecfd80f5-2a18-4a27-ba7e-93b8f9c2e494 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:33.665167 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecfd80f5-2a18-4a27-ba7e-93b8f9c2e494 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:33.665967 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecfd80f5-2a18-4a27-ba7e-93b8f9c2e494 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:33.666414 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ecfd80f5-2a18-4a27-ba7e-93b8f9c2e494 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:33.835586 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ecfd80f5-2a18-4a27-ba7e-93b8f9c2e494 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:33.851212 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ecfd80f5-2a18-4a27-ba7e-93b8f9c2e494 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1278 microversion: 2.1 time: 0.216611 May 10 20:03:33.852126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 324/668] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:33 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:34.870385 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0ffbd0df-f01b-4efd-bf72-96f32ac116ba tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:34.871158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0ffbd0df-f01b-4efd-bf72-96f32ac116ba tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:34.878279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ffbd0df-f01b-4efd-bf72-96f32ac116ba tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:34.879040 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ffbd0df-f01b-4efd-bf72-96f32ac116ba tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:34.879935 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ffbd0df-f01b-4efd-bf72-96f32ac116ba tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:34.880593 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ffbd0df-f01b-4efd-bf72-96f32ac116ba tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:35.044149 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0ffbd0df-f01b-4efd-bf72-96f32ac116ba tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:35.057317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0ffbd0df-f01b-4efd-bf72-96f32ac116ba tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1318 microversion: 2.1 time: 0.191769 May 10 20:03:35.058839 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 345/669] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:34 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:35.254914 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-352b9dfa-9da6-4a74-890a-5b6ef1793f94 req-27c51d59-b88c-4250-9367-0e467c9d151d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4f949c-a6ee-4f9f-8e28-864aaeb99517", "tag": "152b6e28-0758-4d79-8ac9-9589400cbbc8"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:35.270071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-352b9dfa-9da6-4a74-890a-5b6ef1793f94 req-27c51d59-b88c-4250-9367-0e467c9d151d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:35.270544 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-352b9dfa-9da6-4a74-890a-5b6ef1793f94 req-27c51d59-b88c-4250-9367-0e467c9d151d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:35.292216 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-352b9dfa-9da6-4a74-890a-5b6ef1793f94 req-27c51d59-b88c-4250-9367-0e467c9d151d service nova] Creating event network-changed:152b6e28-0758-4d79-8ac9-9589400cbbc8 for instance 1b4f949c-a6ee-4f9f-8e28-864aaeb99517 on hv-cinder-84131 May 10 20:03:35.298970 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-352b9dfa-9da6-4a74-890a-5b6ef1793f94 req-27c51d59-b88c-4250-9367-0e467c9d151d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047692 May 10 20:03:35.299758 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 325/670] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:03:36.076094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5cba6cf4-bc6a-4873-b36b-373a4178f0df tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:36.076714 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5cba6cf4-bc6a-4873-b36b-373a4178f0df tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:36.083664 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5cba6cf4-bc6a-4873-b36b-373a4178f0df tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:36.084414 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5cba6cf4-bc6a-4873-b36b-373a4178f0df tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:36.085198 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5cba6cf4-bc6a-4873-b36b-373a4178f0df tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:36.085638 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5cba6cf4-bc6a-4873-b36b-373a4178f0df tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:36.226600 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5cba6cf4-bc6a-4873-b36b-373a4178f0df tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:36.234377 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5cba6cf4-bc6a-4873-b36b-373a4178f0df tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1318 microversion: 2.1 time: 0.162116 May 10 20:03:36.235004 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 346/671] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:36 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:37.253689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7555b3db-df10-4af5-a5ce-ecec60014e7a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:37.254392 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7555b3db-df10-4af5-a5ce-ecec60014e7a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:37.265103 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7555b3db-df10-4af5-a5ce-ecec60014e7a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:37.267710 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7555b3db-df10-4af5-a5ce-ecec60014e7a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:37.268447 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7555b3db-df10-4af5-a5ce-ecec60014e7a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:37.268890 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7555b3db-df10-4af5-a5ce-ecec60014e7a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:37.473328 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7555b3db-df10-4af5-a5ce-ecec60014e7a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:37.485563 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7555b3db-df10-4af5-a5ce-ecec60014e7a tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1318 microversion: 2.1 time: 0.236379 May 10 20:03:37.486481 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 326/672] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:37 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:38.505233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-23ba7d5d-53e1-451c-9f8e-fa34e3373a37 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:38.506624 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-23ba7d5d-53e1-451c-9f8e-fa34e3373a37 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:38.514112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-23ba7d5d-53e1-451c-9f8e-fa34e3373a37 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:38.514913 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-23ba7d5d-53e1-451c-9f8e-fa34e3373a37 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:38.515938 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-23ba7d5d-53e1-451c-9f8e-fa34e3373a37 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:38.516744 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-23ba7d5d-53e1-451c-9f8e-fa34e3373a37 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:38.680476 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-23ba7d5d-53e1-451c-9f8e-fa34e3373a37 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:38.688121 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-23ba7d5d-53e1-451c-9f8e-fa34e3373a37 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1318 microversion: 2.1 time: 0.187175 May 10 20:03:38.698607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 347/673] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:38 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:39.705200 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-87741e3f-5700-490a-b6b8-60977fd2e99d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:39.705809 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-87741e3f-5700-490a-b6b8-60977fd2e99d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:39.712599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-87741e3f-5700-490a-b6b8-60977fd2e99d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:39.713062 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-87741e3f-5700-490a-b6b8-60977fd2e99d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:39.713850 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-87741e3f-5700-490a-b6b8-60977fd2e99d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:39.714298 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-87741e3f-5700-490a-b6b8-60977fd2e99d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:39.863779 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-87741e3f-5700-490a-b6b8-60977fd2e99d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:39.872836 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-87741e3f-5700-490a-b6b8-60977fd2e99d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1318 microversion: 2.1 time: 0.171337 May 10 20:03:39.873605 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 327/674] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:39 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:40.839410 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-24040f71-a9ab-4e65-bf35-3eb59d1e75a6 req-36b76783-ffde-4777-99ef-8c38a992c2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4f949c-a6ee-4f9f-8e28-864aaeb99517", "name": "network-vif-plugged", "status": "completed", "tag": "152b6e28-0758-4d79-8ac9-9589400cbbc8"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:40.849326 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-24040f71-a9ab-4e65-bf35-3eb59d1e75a6 req-36b76783-ffde-4777-99ef-8c38a992c2e9 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:40.853095 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-24040f71-a9ab-4e65-bf35-3eb59d1e75a6 req-36b76783-ffde-4777-99ef-8c38a992c2e9 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:40.868833 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-24040f71-a9ab-4e65-bf35-3eb59d1e75a6 req-36b76783-ffde-4777-99ef-8c38a992c2e9 service nova] Creating event network-vif-plugged:152b6e28-0758-4d79-8ac9-9589400cbbc8 for instance 1b4f949c-a6ee-4f9f-8e28-864aaeb99517 on hv-cinder-84131 May 10 20:03:40.877542 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-24040f71-a9ab-4e65-bf35-3eb59d1e75a6 req-36b76783-ffde-4777-99ef-8c38a992c2e9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042979 May 10 20:03:40.878547 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 348/675] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:03:40.889197 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-43b06d6a-3ab3-4724-9335-2b5561f6b864 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:40.890356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-43b06d6a-3ab3-4724-9335-2b5561f6b864 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:40.899399 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43b06d6a-3ab3-4724-9335-2b5561f6b864 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:40.900293 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43b06d6a-3ab3-4724-9335-2b5561f6b864 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:40.901322 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43b06d6a-3ab3-4724-9335-2b5561f6b864 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:40.901826 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43b06d6a-3ab3-4724-9335-2b5561f6b864 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:41.100469 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-43b06d6a-3ab3-4724-9335-2b5561f6b864 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:41.110306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-43b06d6a-3ab3-4724-9335-2b5561f6b864 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1318 microversion: 2.1 time: 0.224821 May 10 20:03:41.111836 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 328/676] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:40 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:42.129866 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-19e6e82d-b8be-486b-b058-a21855ed3c43 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:42.132201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-19e6e82d-b8be-486b-b058-a21855ed3c43 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:42.139913 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-19e6e82d-b8be-486b-b058-a21855ed3c43 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:42.140717 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-19e6e82d-b8be-486b-b058-a21855ed3c43 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:42.141897 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-19e6e82d-b8be-486b-b058-a21855ed3c43 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:42.142489 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-19e6e82d-b8be-486b-b058-a21855ed3c43 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:42.322947 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-19e6e82d-b8be-486b-b058-a21855ed3c43 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:42.332260 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-19e6e82d-b8be-486b-b058-a21855ed3c43 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1318 microversion: 2.1 time: 0.207228 May 10 20:03:42.334655 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 349/677] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:42 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:43.350153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8723aa7d-1d2f-4145-b3c3-04fe5335afce tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:43.350806 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8723aa7d-1d2f-4145-b3c3-04fe5335afce tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:43.357724 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8723aa7d-1d2f-4145-b3c3-04fe5335afce tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:43.358178 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8723aa7d-1d2f-4145-b3c3-04fe5335afce tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:43.359005 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8723aa7d-1d2f-4145-b3c3-04fe5335afce tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:43.359451 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8723aa7d-1d2f-4145-b3c3-04fe5335afce tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:43.530737 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8723aa7d-1d2f-4145-b3c3-04fe5335afce tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:43.537355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8723aa7d-1d2f-4145-b3c3-04fe5335afce tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1505 microversion: 2.1 time: 0.191213 May 10 20:03:43.537870 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 329/678] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:43 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:49.565474 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d9d88472-8210-42b5-a284-0cdce79dfa0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:49.566100 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d9d88472-8210-42b5-a284-0cdce79dfa0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:49.573375 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9d88472-8210-42b5-a284-0cdce79dfa0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:49.573936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9d88472-8210-42b5-a284-0cdce79dfa0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:49.574838 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9d88472-8210-42b5-a284-0cdce79dfa0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:49.575321 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d9d88472-8210-42b5-a284-0cdce79dfa0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:49.604782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d9d88472-8210-42b5-a284-0cdce79dfa0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-volume_attachments/9e6c38eb-7dee-4441-94de-9ffacb2dc3ac" status: 200 len: 194 microversion: 2.20 time: 0.043353 May 10 20:03:49.605633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 350/679] 10.222.0.57 () {60 vars in 1453 bytes} [Tue May 10 20:03:49 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-volume_attachments/9e6c38eb-7dee-4441-94de-9ffacb2dc3ac => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:03:49.671837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d4330a1d-700a-4404-8518-66dfc4e6e2bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:49.672553 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d4330a1d-700a-4404-8518-66dfc4e6e2bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:49.679831 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d4330a1d-700a-4404-8518-66dfc4e6e2bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:49.684528 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d4330a1d-700a-4404-8518-66dfc4e6e2bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:49.685620 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d4330a1d-700a-4404-8518-66dfc4e6e2bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:49.686233 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d4330a1d-700a-4404-8518-66dfc4e6e2bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:49.785202 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-d4330a1d-700a-4404-8518-66dfc4e6e2bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lazy-loading 'services' on Instance uuid ff53e635-0740-4f22-9c5b-8d8dd47571c5 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:03:49.875912 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d4330a1d-700a-4404-8518-66dfc4e6e2bf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-volume_attachments/9e6c38eb-7dee-4441-94de-9ffacb2dc3ac" status: 202 len: 0 microversion: 2.20 time: 0.207840 May 10 20:03:49.876588 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 330/680] 10.222.0.57 () {60 vars in 1456 bytes} [Tue May 10 20:03:49 2022] DELETE /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-volume_attachments/9e6c38eb-7dee-4441-94de-9ffacb2dc3ac => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 20:03:49.885699 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6550850a-4bae-469a-a729-b042cb3a1e7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:49.886666 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6550850a-4bae-469a-a729-b042cb3a1e7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:49.895196 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6550850a-4bae-469a-a729-b042cb3a1e7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:49.897569 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6550850a-4bae-469a-a729-b042cb3a1e7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:49.898734 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6550850a-4bae-469a-a729-b042cb3a1e7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:49.899311 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6550850a-4bae-469a-a729-b042cb3a1e7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:49.935078 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6550850a-4bae-469a-a729-b042cb3a1e7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053526 May 10 20:03:49.936178 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 351/681] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 20:03:49 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:03:50.271452 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-569044886", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-209518868", "security_groups": [{"name": "tempest-secgroup-smoke-470214062"}], "block_device_mapping_v2": [{"uuid": "4bb8bd08-f057-45c5-8406-71cd25a3eed1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d20c2327-06bd-4a9c-bc81-ab7a5e947390"}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:50.379662 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] validate_networks() for [('d20c2327-06bd-4a9c-bc81-ab7a5e947390', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:03:50.755470 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:03:50.756023 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:03:50.756444 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:03:50.756855 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:03:50.757269 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:03:50.767199 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:50.767655 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:50.768470 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:50.768912 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:50.785416 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Getting quotas for project 493768250fbb449a8b5430992e76b60f. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:03:50.790409 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Getting quotas for user be0ebfb74d254359b4dfa36d9aff4ac6 and project 493768250fbb449a8b5430992e76b60f. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:03:50.848344 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:03:50.851490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bb8bd08-f057-45c5-8406-71cd25a3eed1',volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:03:50.947997 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a8b56b78-2fe5-4a43-a88a-49ec2ec04fd2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:50.948977 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a8b56b78-2fe5-4a43-a88a-49ec2ec04fd2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:50.955414 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a8b56b78-2fe5-4a43-a88a-49ec2ec04fd2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:50.955888 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a8b56b78-2fe5-4a43-a88a-49ec2ec04fd2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:50.956674 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a8b56b78-2fe5-4a43-a88a-49ec2ec04fd2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:50.957180 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a8b56b78-2fe5-4a43-a88a-49ec2ec04fd2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:50.982488 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1f2cab0e-09d3-4378-b2c2-c562df622af6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.715441 May 10 20:03:50.983152 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 331/682] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:03:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:03:50.988697 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a8b56b78-2fe5-4a43-a88a-49ec2ec04fd2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045407 May 10 20:03:50.993386 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b15ad204-ba66-411c-a9a2-496e7920fe6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:50.994063 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 352/683] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 20:03:50 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:03:50.994542 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b15ad204-ba66-411c-a9a2-496e7920fe6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:51.058741 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c7445a9e-a67c-4942-ae29-491d475b2782 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:51.059250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c7445a9e-a67c-4942-ae29-491d475b2782 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:51.060792 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b15ad204-ba66-411c-a9a2-496e7920fe6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:51.065188 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7445a9e-a67c-4942-ae29-491d475b2782 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:51.065653 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7445a9e-a67c-4942-ae29-491d475b2782 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:51.066435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7445a9e-a67c-4942-ae29-491d475b2782 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:51.066909 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7445a9e-a67c-4942-ae29-491d475b2782 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:51.067950 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b15ad204-ba66-411c-a9a2-496e7920fe6c tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1093 microversion: 2.1 time: 0.078875 May 10 20:03:51.077407 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 332/684] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:50 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:51.097029 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c7445a9e-a67c-4942-ae29-491d475b2782 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:03:51.198861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c7445a9e-a67c-4942-ae29-491d475b2782 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 204 len: 0 microversion: 2.20 time: 0.143247 May 10 20:03:51.199955 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 353/685] 10.222.0.57 () {60 vars in 1279 bytes} [Tue May 10 20:03:51 2022] DELETE /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 20:03:51.211686 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9629728d-953e-477c-9990-add740371345 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:51.212607 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9629728d-953e-477c-9990-add740371345 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:51.223703 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9629728d-953e-477c-9990-add740371345 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:51.224168 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9629728d-953e-477c-9990-add740371345 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:51.224976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9629728d-953e-477c-9990-add740371345 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:51.226053 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9629728d-953e-477c-9990-add740371345 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:51.397662 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9629728d-953e-477c-9990-add740371345 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:51.405996 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9629728d-953e-477c-9990-add740371345 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:51.408307 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9629728d-953e-477c-9990-add740371345 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:51.409494 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9629728d-953e-477c-9990-add740371345 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.204966 May 10 20:03:51.420659 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 333/686] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:51 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:52.085671 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-de9e8224-1c0c-45c2-b0fe-2aa0380ef9cc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:52.086527 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-de9e8224-1c0c-45c2-b0fe-2aa0380ef9cc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:52.092864 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-de9e8224-1c0c-45c2-b0fe-2aa0380ef9cc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:52.093408 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-de9e8224-1c0c-45c2-b0fe-2aa0380ef9cc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:52.094092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-de9e8224-1c0c-45c2-b0fe-2aa0380ef9cc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:52.094546 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-de9e8224-1c0c-45c2-b0fe-2aa0380ef9cc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:52.156861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-de9e8224-1c0c-45c2-b0fe-2aa0380ef9cc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:52.164666 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-de9e8224-1c0c-45c2-b0fe-2aa0380ef9cc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1143 microversion: 2.1 time: 0.083271 May 10 20:03:52.165295 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 354/687] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:52 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:52.428138 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c3ba1409-efd4-41d9-b841-5e0c26f7807c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:52.428783 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c3ba1409-efd4-41d9-b841-5e0c26f7807c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:52.436652 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c3ba1409-efd4-41d9-b841-5e0c26f7807c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:52.437118 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c3ba1409-efd4-41d9-b841-5e0c26f7807c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:52.437881 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c3ba1409-efd4-41d9-b841-5e0c26f7807c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:52.438316 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c3ba1409-efd4-41d9-b841-5e0c26f7807c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:52.572352 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c3ba1409-efd4-41d9-b841-5e0c26f7807c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:52.580098 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c3ba1409-efd4-41d9-b841-5e0c26f7807c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:52.582934 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c3ba1409-efd4-41d9-b841-5e0c26f7807c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:52.584107 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c3ba1409-efd4-41d9-b841-5e0c26f7807c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.159900 May 10 20:03:52.584682 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 334/688] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:52 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:53.182627 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-896dfdc4-9291-4e06-983a-2f3207084f2f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:53.183251 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-896dfdc4-9291-4e06-983a-2f3207084f2f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:53.189761 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-896dfdc4-9291-4e06-983a-2f3207084f2f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:53.190510 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-896dfdc4-9291-4e06-983a-2f3207084f2f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:53.192683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-896dfdc4-9291-4e06-983a-2f3207084f2f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:53.193322 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-896dfdc4-9291-4e06-983a-2f3207084f2f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:53.270383 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-896dfdc4-9291-4e06-983a-2f3207084f2f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:53.278467 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-896dfdc4-9291-4e06-983a-2f3207084f2f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1191 microversion: 2.1 time: 0.100088 May 10 20:03:53.279566 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 355/689] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:53 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:53.605708 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-82cdfd81-98c2-4f75-8b54-99585ec00203 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:53.607089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-82cdfd81-98c2-4f75-8b54-99585ec00203 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:53.613875 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82cdfd81-98c2-4f75-8b54-99585ec00203 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:53.615105 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82cdfd81-98c2-4f75-8b54-99585ec00203 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:53.616147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82cdfd81-98c2-4f75-8b54-99585ec00203 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:53.616802 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82cdfd81-98c2-4f75-8b54-99585ec00203 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:53.951260 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-82cdfd81-98c2-4f75-8b54-99585ec00203 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:53.961267 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-82cdfd81-98c2-4f75-8b54-99585ec00203 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:53.963802 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-82cdfd81-98c2-4f75-8b54-99585ec00203 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:53.965600 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-82cdfd81-98c2-4f75-8b54-99585ec00203 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1723 microversion: 2.20 time: 0.365222 May 10 20:03:53.966684 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 335/690] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:53 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1723 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:54.301987 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-451fa5c8-165c-4579-a25d-62123a302871 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:54.303191 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-451fa5c8-165c-4579-a25d-62123a302871 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:54.311665 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-451fa5c8-165c-4579-a25d-62123a302871 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:54.312334 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-451fa5c8-165c-4579-a25d-62123a302871 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:54.313575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-451fa5c8-165c-4579-a25d-62123a302871 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:54.314599 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-451fa5c8-165c-4579-a25d-62123a302871 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:54.384032 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-451fa5c8-165c-4579-a25d-62123a302871 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:54.400175 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-451fa5c8-165c-4579-a25d-62123a302871 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1197 microversion: 2.1 time: 0.104100 May 10 20:03:54.408405 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 356/691] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:54 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:54.985744 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c5d85277-f00b-40b2-a9cd-a0013c0ef602 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:54.986496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c5d85277-f00b-40b2-a9cd-a0013c0ef602 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:54.993379 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c5d85277-f00b-40b2-a9cd-a0013c0ef602 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:54.993844 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c5d85277-f00b-40b2-a9cd-a0013c0ef602 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:54.994653 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c5d85277-f00b-40b2-a9cd-a0013c0ef602 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:54.995098 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c5d85277-f00b-40b2-a9cd-a0013c0ef602 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:55.108336 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c5d85277-f00b-40b2-a9cd-a0013c0ef602 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:55.116705 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c5d85277-f00b-40b2-a9cd-a0013c0ef602 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:55.119455 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c5d85277-f00b-40b2-a9cd-a0013c0ef602 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:55.120718 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c5d85277-f00b-40b2-a9cd-a0013c0ef602 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 200 len: 1655 microversion: 2.20 time: 0.139293 May 10 20:03:55.121711 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 336/692] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:54 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 1655 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:03:55.257057 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-9ce975c5-b60c-4e13-bf3f-e81080495a8e req-93760b8f-0329-4f65-a626-a7bd1e3e4227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff53e635-0740-4f22-9c5b-8d8dd47571c5", "name": "network-vif-deleted", "tag": "740fa7f3-ee5c-4744-9541-a814cc75f111"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:55.276576 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-9ce975c5-b60c-4e13-bf3f-e81080495a8e req-93760b8f-0329-4f65-a626-a7bd1e3e4227 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:55.276576 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-9ce975c5-b60c-4e13-bf3f-e81080495a8e req-93760b8f-0329-4f65-a626-a7bd1e3e4227 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:55.298339 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-9ce975c5-b60c-4e13-bf3f-e81080495a8e req-93760b8f-0329-4f65-a626-a7bd1e3e4227 service nova] Creating event network-vif-deleted:740fa7f3-ee5c-4744-9541-a814cc75f111 for instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 on hv-cinder-84131 May 10 20:03:55.303667 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-9ce975c5-b60c-4e13-bf3f-e81080495a8e req-93760b8f-0329-4f65-a626-a7bd1e3e4227 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051316 May 10 20:03:55.304685 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 357/693] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:03:55.419114 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e81e3119-5717-4159-b8ec-19ebddfb3dbb tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:55.419734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e81e3119-5717-4159-b8ec-19ebddfb3dbb tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:55.425526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e81e3119-5717-4159-b8ec-19ebddfb3dbb tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:55.425982 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e81e3119-5717-4159-b8ec-19ebddfb3dbb tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:55.426819 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e81e3119-5717-4159-b8ec-19ebddfb3dbb tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:55.427259 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e81e3119-5717-4159-b8ec-19ebddfb3dbb tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:55.667258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e81e3119-5717-4159-b8ec-19ebddfb3dbb tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:55.676867 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e81e3119-5717-4159-b8ec-19ebddfb3dbb tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.263406 May 10 20:03:55.687129 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 337/694] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:55 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:56.042914 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1757749449", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:56.111059 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] validate_networks() for None {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:03:56.140450 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0768ee53-9015-4c97-85f4-2318c234436c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:56.144315 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0768ee53-9015-4c97-85f4-2318c234436c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:56.153939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0768ee53-9015-4c97-85f4-2318c234436c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:56.154655 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0768ee53-9015-4c97-85f4-2318c234436c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:56.155217 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0768ee53-9015-4c97-85f4-2318c234436c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:56.155662 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0768ee53-9015-4c97-85f4-2318c234436c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:56.194342 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-0768ee53-9015-4c97-85f4-2318c234436c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] HTTP exception thrown: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0768ee53-9015-4c97-85f4-2318c234436c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Request method failure captured: May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 HTTP/1.1 May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesSP1BBgKmmoT2a2uWApYh5c83TN5BA9-mhqELVsXpjp1qDc61mPBi07hnriXhtnpSyjp8k0Fe99LpxlaWczMB__yyzsHpzZrNYL0RM05-At2UoVDpEheTar91vc2H2NLHhH5_ZT-JvfXIR9blR8dzy905R69ZmxXEOVnkIjNMoAa_4 May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:03:56.196436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3f7d501f555c4a0ba2419f68ba756db7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3f7d501f555c4a0ba2419f68ba756db7"}]}] May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 56653f5922984dde83b35ba154e97bd0 May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:03:56.197939 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': 'ff53e635-0740-4f22-9c5b-8d8dd47571c5'} May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:03:56.198951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:03:56.200360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:03:56.202545 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0768ee53-9015-4c97-85f4-2318c234436c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Returning 404 to user: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:03:56.203628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0768ee53-9015-4c97-85f4-2318c234436c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 404 len: 111 microversion: 2.20 time: 0.068522 May 10 20:03:56.204717 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 338/695] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:56 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 20:03:56.214247 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f87e9884-c819-4720-a9a9-2af9c7da3f50 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '.version_select at 0x7fdd398eea60>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:56.244452 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f87e9884-c819-4720-a9a9-2af9c7da3f50 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17528227" status: 204 len: 0 microversion: 2.20 time: 0.035263 May 10 20:03:56.245911 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 339/696] 10.222.0.57 () {60 vars in 1255 bytes} [Tue May 10 20:03:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17528227 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 20:03:56.699021 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d100937d-ea26-40fc-b07a-7d644a3693c6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:56.700259 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d100937d-ea26-40fc-b07a-7d644a3693c6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:56.706742 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d100937d-ea26-40fc-b07a-7d644a3693c6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:56.707510 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d100937d-ea26-40fc-b07a-7d644a3693c6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:56.708491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d100937d-ea26-40fc-b07a-7d644a3693c6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:56.709073 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d100937d-ea26-40fc-b07a-7d644a3693c6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:56.745341 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:03:56.745824 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:03:56.746244 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:03:56.746756 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:03:56.747385 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:03:56.757881 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:56.758639 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:56.759596 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:56.760130 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:56.776680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Getting quotas for project 7812c5045988421aa82845f73e66b2a1. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:03:56.780610 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Getting quotas for user 274e6e1e975f45ad92a18f88094b414a and project 7812c5045988421aa82845f73e66b2a1. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:03:56.792477 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:03:56.795081 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:03:56.838776 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-024939f4-0e6d-4500-a26b-bda77bb939a4 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800633 May 10 20:03:56.839471 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 358/697] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:03:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:03:56.857295 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-80d32bcb-9c0c-43f5-975e-7d30fc91fddf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:56.859589 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-80d32bcb-9c0c-43f5-975e-7d30fc91fddf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:56.920026 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-80d32bcb-9c0c-43f5-975e-7d30fc91fddf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:56.926759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-80d32bcb-9c0c-43f5-975e-7d30fc91fddf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1215 microversion: 2.1 time: 0.079018 May 10 20:03:56.934778 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 359/698] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:56 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:56.995035 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d100937d-ea26-40fc-b07a-7d644a3693c6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:57.003241 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d100937d-ea26-40fc-b07a-7d644a3693c6 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.313663 May 10 20:03:57.004655 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 340/699] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:56 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:57.304000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-afa97147-6fef-4eb8-afe9-f18f4d3b530a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Action: 'create', calling method: .version_select at 0x7fdd391620d0>, body: {"keypair": {"name": "tempest-keypair-648228011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlm+X7LE5b08U3FdDgtN78HnshBuxqcf0rWB/T0phyq/+m9QzhqkQ+1OjNfy0zudm+dQlSxN3teUhVXFD2w2WA1QflKPt7QQTPUNy73Ybpx2inn4yjypq5MjFrcQpIWog=="}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:57.319173 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-afa97147-6fef-4eb8-afe9-f18f4d3b530a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Getting quotas for project 3f7d501f555c4a0ba2419f68ba756db7. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:03:57.323705 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-afa97147-6fef-4eb8-afe9-f18f4d3b530a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Getting quotas for user 56653f5922984dde83b35ba154e97bd0 and project 3f7d501f555c4a0ba2419f68ba756db7. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:03:57.344983 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-9d3781aa-0826-4140-ae66-8eb3b1a98ece req-5250861e-47ef-4851-bbea-661888441199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ba59142-196f-4c2d-9795-fdeba5da92e3", "tag": "b394e984-72e7-4807-85f2-d6717d5ed1e4"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:57.346368 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-afa97147-6fef-4eb8-afe9-f18f4d3b530a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046407 May 10 20:03:57.347039 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 360/700] 10.222.0.57 () {62 vars in 1199 bytes} [Tue May 10 20:03:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 20:03:57.356811 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-9d3781aa-0826-4140-ae66-8eb3b1a98ece req-5250861e-47ef-4851-bbea-661888441199 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:57.357332 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-9d3781aa-0826-4140-ae66-8eb3b1a98ece req-5250861e-47ef-4851-bbea-661888441199 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:57.369450 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-9d3781aa-0826-4140-ae66-8eb3b1a98ece req-5250861e-47ef-4851-bbea-661888441199 service nova] Creating event network-changed:b394e984-72e7-4807-85f2-d6717d5ed1e4 for instance 6ba59142-196f-4c2d-9795-fdeba5da92e3 on hv-cinder-84131 May 10 20:03:57.375167 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-9d3781aa-0826-4140-ae66-8eb3b1a98ece req-5250861e-47ef-4851-bbea-661888441199 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034447 May 10 20:03:57.376886 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 341/701] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:03:57.946268 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-053f36e7-148d-4222-945c-934b1f6ca688 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:57.946836 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-053f36e7-148d-4222-945c-934b1f6ca688 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:57.964756 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-053f36e7-148d-4222-945c-934b1f6ca688 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:57.965119 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-053f36e7-148d-4222-945c-934b1f6ca688 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:57.965918 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-053f36e7-148d-4222-945c-934b1f6ca688 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:57.966738 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-053f36e7-148d-4222-945c-934b1f6ca688 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:58.057591 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-053f36e7-148d-4222-945c-934b1f6ca688 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:58.074927 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-053f36e7-148d-4222-945c-934b1f6ca688 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1273 microversion: 2.1 time: 0.134444 May 10 20:03:58.084785 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 361/702] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:57 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:03:58.211259 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f7410c01-3271-4d35-a53b-7c85e832e951 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:58.212212 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f7410c01-3271-4d35-a53b-7c85e832e951 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:58.219051 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7410c01-3271-4d35-a53b-7c85e832e951 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:58.219709 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7410c01-3271-4d35-a53b-7c85e832e951 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:58.220902 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7410c01-3271-4d35-a53b-7c85e832e951 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:58.221538 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7410c01-3271-4d35-a53b-7c85e832e951 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:58.451933 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f7410c01-3271-4d35-a53b-7c85e832e951 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:58.459530 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f7410c01-3271-4d35-a53b-7c85e832e951 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.442177 May 10 20:03:58.460173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 342/703] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:58 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:03:58.730927 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1535559735", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d96601e-070f-42ce-b6bb-05d8030298ee"}], "security_groups": [{"name": "tempest-securitygroup--494133250"}], "key_name": "tempest-keypair-648228011", "user_data": "}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:03:58.837066 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] validate_networks() for [('4d96601e-070f-42ce-b6bb-05d8030298ee', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:03:59.092076 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f2db64bd-d25f-4e49-9177-6c729cce4806 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:59.092688 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f2db64bd-d25f-4e49-9177-6c729cce4806 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:59.098756 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f2db64bd-d25f-4e49-9177-6c729cce4806 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:59.099210 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f2db64bd-d25f-4e49-9177-6c729cce4806 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:59.099982 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f2db64bd-d25f-4e49-9177-6c729cce4806 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:59.100599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f2db64bd-d25f-4e49-9177-6c729cce4806 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:59.236660 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:03:59.237156 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:03:59.237690 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:03:59.238172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:03:59.238725 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:03:59.248426 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:59.248946 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:59.249823 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:59.250257 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:59.267139 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Getting quotas for project 3f7d501f555c4a0ba2419f68ba756db7. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:03:59.270941 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Getting quotas for user 56653f5922984dde83b35ba154e97bd0 and project 3f7d501f555c4a0ba2419f68ba756db7. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:03:59.281892 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:03:59.284064 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:03:59.332017 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e97fe7d9-ec2f-4650-b7b9-22580d709116 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.605245 May 10 20:03:59.332790 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 362/704] 10.222.0.57 () {62 vars in 1187 bytes} [Tue May 10 20:03:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 20:03:59.343227 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d8e01905-9083-4046-9a7f-fdaee03d16d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:59.343947 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d8e01905-9083-4046-9a7f-fdaee03d16d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:59.399984 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d8e01905-9083-4046-9a7f-fdaee03d16d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:59.408858 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d8e01905-9083-4046-9a7f-fdaee03d16d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:59.410731 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d8e01905-9083-4046-9a7f-fdaee03d16d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:59.412107 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d8e01905-9083-4046-9a7f-fdaee03d16d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1281 microversion: 2.20 time: 0.072991 May 10 20:03:59.414494 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 363/705] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:03:59 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:03:59.477000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-438305d7-43b1-4f91-8481-3bb2d17196d8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:03:59.477624 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-438305d7-43b1-4f91-8481-3bb2d17196d8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:03:59.484705 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-438305d7-43b1-4f91-8481-3bb2d17196d8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:59.485166 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-438305d7-43b1-4f91-8481-3bb2d17196d8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:59.485998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-438305d7-43b1-4f91-8481-3bb2d17196d8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:03:59.486696 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-438305d7-43b1-4f91-8481-3bb2d17196d8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:03:59.639704 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-438305d7-43b1-4f91-8481-3bb2d17196d8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:59.643338 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f2db64bd-d25f-4e49-9177-6c729cce4806 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:03:59.648507 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-438305d7-43b1-4f91-8481-3bb2d17196d8 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.175347 May 10 20:03:59.651020 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 364/706] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:59 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:03:59.661637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f2db64bd-d25f-4e49-9177-6c729cce4806 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.573453 May 10 20:03:59.662553 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 343/707] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:03:59 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:00.038216 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-68638bab-544a-4581-b491-28dc525d4317 req-815182f0-f134-4bc4-93eb-dab52e41dc7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2268fb12-3e45-4d7c-bb6a-c59e140dc79f", "tag": "34dbba1c-4e73-4f41-96f8-80ce28c99512"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:00.050989 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-68638bab-544a-4581-b491-28dc525d4317 req-815182f0-f134-4bc4-93eb-dab52e41dc7c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:00.051803 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-68638bab-544a-4581-b491-28dc525d4317 req-815182f0-f134-4bc4-93eb-dab52e41dc7c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:00.069246 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-68638bab-544a-4581-b491-28dc525d4317 req-815182f0-f134-4bc4-93eb-dab52e41dc7c service nova] Creating event network-changed:34dbba1c-4e73-4f41-96f8-80ce28c99512 for instance 2268fb12-3e45-4d7c-bb6a-c59e140dc79f on hv-cinder-84131 May 10 20:04:00.075059 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-68638bab-544a-4581-b491-28dc525d4317 req-815182f0-f134-4bc4-93eb-dab52e41dc7c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041317 May 10 20:04:00.075960 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 365/708] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:04:00.431670 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-313e5193-df74-4704-983f-aec6aae6a9c7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:00.432849 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-313e5193-df74-4704-983f-aec6aae6a9c7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:00.439337 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-313e5193-df74-4704-983f-aec6aae6a9c7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:00.440179 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-313e5193-df74-4704-983f-aec6aae6a9c7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:00.441090 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-313e5193-df74-4704-983f-aec6aae6a9c7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:00.441617 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-313e5193-df74-4704-983f-aec6aae6a9c7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:00.535516 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-313e5193-df74-4704-983f-aec6aae6a9c7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:00.544800 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-313e5193-df74-4704-983f-aec6aae6a9c7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:00.546360 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-313e5193-df74-4704-983f-aec6aae6a9c7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:00.548843 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-313e5193-df74-4704-983f-aec6aae6a9c7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1351 microversion: 2.20 time: 0.121346 May 10 20:04:00.549868 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 344/709] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:00 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:04:00.667476 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-29872ef9-7540-45f1-8b44-c2a59e58019e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:00.668211 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-29872ef9-7540-45f1-8b44-c2a59e58019e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:00.674357 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29872ef9-7540-45f1-8b44-c2a59e58019e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:00.674855 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29872ef9-7540-45f1-8b44-c2a59e58019e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:00.675630 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29872ef9-7540-45f1-8b44-c2a59e58019e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:00.676073 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29872ef9-7540-45f1-8b44-c2a59e58019e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:00.678710 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-17004744-8be3-4a97-87bc-e2ca6584e60d tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:00.679830 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-17004744-8be3-4a97-87bc-e2ca6584e60d tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:00.685618 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-17004744-8be3-4a97-87bc-e2ca6584e60d tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:00.686070 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-17004744-8be3-4a97-87bc-e2ca6584e60d tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:00.686876 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-17004744-8be3-4a97-87bc-e2ca6584e60d tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:00.687317 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-17004744-8be3-4a97-87bc-e2ca6584e60d tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:00.813318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-29872ef9-7540-45f1-8b44-c2a59e58019e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:00.821302 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-29872ef9-7540-45f1-8b44-c2a59e58019e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.158068 May 10 20:04:00.821879 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 366/710] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:00 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:00.979673 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-17004744-8be3-4a97-87bc-e2ca6584e60d tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:00.987470 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-17004744-8be3-4a97-87bc-e2ca6584e60d tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.312564 May 10 20:04:00.988048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 345/711] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:00 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:04:01.571788 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9cdbe2c2-3ece-43a2-92a5-dce7093dedf3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:01.572407 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9cdbe2c2-3ece-43a2-92a5-dce7093dedf3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:01.579277 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9cdbe2c2-3ece-43a2-92a5-dce7093dedf3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:01.579738 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9cdbe2c2-3ece-43a2-92a5-dce7093dedf3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:01.580529 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9cdbe2c2-3ece-43a2-92a5-dce7093dedf3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:01.580973 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9cdbe2c2-3ece-43a2-92a5-dce7093dedf3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:01.710815 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9cdbe2c2-3ece-43a2-92a5-dce7093dedf3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:01.718740 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9cdbe2c2-3ece-43a2-92a5-dce7093dedf3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:01.720316 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9cdbe2c2-3ece-43a2-92a5-dce7093dedf3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:01.721523 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9cdbe2c2-3ece-43a2-92a5-dce7093dedf3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.154234 May 10 20:04:01.722170 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 367/712] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:01 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:01.838475 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3fbbf5c6-42a0-42de-84f9-8cccf1bb82dc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:01.839097 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3fbbf5c6-42a0-42de-84f9-8cccf1bb82dc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:01.845417 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fbbf5c6-42a0-42de-84f9-8cccf1bb82dc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:01.845873 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fbbf5c6-42a0-42de-84f9-8cccf1bb82dc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:01.846683 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fbbf5c6-42a0-42de-84f9-8cccf1bb82dc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:01.847128 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fbbf5c6-42a0-42de-84f9-8cccf1bb82dc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:01.968183 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-89a64704-7bd5-4c44-b104-232d1a97a522 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea73e53e-1d7e-4ec5-b83f-5e4ae050a401", "device": "/dev/sdb"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:01.969757 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-89a64704-7bd5-4c44-b104-232d1a97a522 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:01.975513 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89a64704-7bd5-4c44-b104-232d1a97a522 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:01.976018 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89a64704-7bd5-4c44-b104-232d1a97a522 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:01.977371 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89a64704-7bd5-4c44-b104-232d1a97a522 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:01.977825 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89a64704-7bd5-4c44-b104-232d1a97a522 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:01.984659 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3fbbf5c6-42a0-42de-84f9-8cccf1bb82dc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:01.992340 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3fbbf5c6-42a0-42de-84f9-8cccf1bb82dc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.158238 May 10 20:04:01.993022 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 346/713] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:01 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:02.005726 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-46f9c7da-c514-4b87-a94c-4506c6c874ea tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:02.006429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-46f9c7da-c514-4b87-a94c-4506c6c874ea tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:02.014575 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46f9c7da-c514-4b87-a94c-4506c6c874ea tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:02.015038 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46f9c7da-c514-4b87-a94c-4506c6c874ea tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:02.015817 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46f9c7da-c514-4b87-a94c-4506c6c874ea tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:02.016339 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46f9c7da-c514-4b87-a94c-4506c6c874ea tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:02.223534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-89a64704-7bd5-4c44-b104-232d1a97a522 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "POST /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259150 May 10 20:04:02.229265 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 368/714] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 20:04:01 2022] POST /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:04:02.257448 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-46f9c7da-c514-4b87-a94c-4506c6c874ea tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:02.265005 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-46f9c7da-c514-4b87-a94c-4506c6c874ea tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.262881 May 10 20:04:02.266002 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 347/715] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:02 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:04:02.741242 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5d3ddf83-0432-4f93-a80a-f8ada1a77cc9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:02.742084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5d3ddf83-0432-4f93-a80a-f8ada1a77cc9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:02.748647 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d3ddf83-0432-4f93-a80a-f8ada1a77cc9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:02.749230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d3ddf83-0432-4f93-a80a-f8ada1a77cc9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:02.750225 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d3ddf83-0432-4f93-a80a-f8ada1a77cc9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:02.750891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d3ddf83-0432-4f93-a80a-f8ada1a77cc9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:02.835084 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-11919c4c-747b-4009-be98-c20a7aa49247 req-708c7ef2-5dd1-4f77-a4e0-9a05468c87d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5", "tag": "ce79326e-c370-40ae-ba6d-04bd30bc39a2"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:02.851891 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-11919c4c-747b-4009-be98-c20a7aa49247 req-708c7ef2-5dd1-4f77-a4e0-9a05468c87d0 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:02.852488 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-11919c4c-747b-4009-be98-c20a7aa49247 req-708c7ef2-5dd1-4f77-a4e0-9a05468c87d0 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:02.866187 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-11919c4c-747b-4009-be98-c20a7aa49247 req-708c7ef2-5dd1-4f77-a4e0-9a05468c87d0 service nova] Creating event network-changed:ce79326e-c370-40ae-ba6d-04bd30bc39a2 for instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 on hv-cinder-84131 May 10 20:04:02.878778 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-11919c4c-747b-4009-be98-c20a7aa49247 req-708c7ef2-5dd1-4f77-a4e0-9a05468c87d0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047493 May 10 20:04:02.879395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 348/716] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:04:02.893039 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5d3ddf83-0432-4f93-a80a-f8ada1a77cc9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:02.902003 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5d3ddf83-0432-4f93-a80a-f8ada1a77cc9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:02.903538 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5d3ddf83-0432-4f93-a80a-f8ada1a77cc9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:02.904653 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5d3ddf83-0432-4f93-a80a-f8ada1a77cc9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.168533 May 10 20:04:02.905399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 369/717] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:02 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:03.011243 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e7037446-84bf-4a45-8524-222eaf2f0322 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:03.012123 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e7037446-84bf-4a45-8524-222eaf2f0322 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:03.019037 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e7037446-84bf-4a45-8524-222eaf2f0322 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:03.019501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e7037446-84bf-4a45-8524-222eaf2f0322 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:03.020279 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e7037446-84bf-4a45-8524-222eaf2f0322 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:03.020716 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e7037446-84bf-4a45-8524-222eaf2f0322 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:03.281996 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cdc28725-d84f-4c47-b6b4-ec346277558c tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:03.282700 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cdc28725-d84f-4c47-b6b4-ec346277558c tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:03.288999 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cdc28725-d84f-4c47-b6b4-ec346277558c tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:03.289451 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cdc28725-d84f-4c47-b6b4-ec346277558c tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:03.290229 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cdc28725-d84f-4c47-b6b4-ec346277558c tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:03.290701 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cdc28725-d84f-4c47-b6b4-ec346277558c tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:03.331709 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e7037446-84bf-4a45-8524-222eaf2f0322 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:03.344843 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e7037446-84bf-4a45-8524-222eaf2f0322 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.338886 May 10 20:04:03.345622 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 349/718] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:03 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:03.441033 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cdc28725-d84f-4c47-b6b4-ec346277558c tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:03.449087 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cdc28725-d84f-4c47-b6b4-ec346277558c tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.170983 May 10 20:04:03.449868 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 370/719] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:03 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:04:03.922975 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e51f2967-dfae-46f8-adc6-0aed4a79a3d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:03.923675 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e51f2967-dfae-46f8-adc6-0aed4a79a3d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:03.931002 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e51f2967-dfae-46f8-adc6-0aed4a79a3d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:03.931437 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e51f2967-dfae-46f8-adc6-0aed4a79a3d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:03.932224 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e51f2967-dfae-46f8-adc6-0aed4a79a3d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:03.932657 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e51f2967-dfae-46f8-adc6-0aed4a79a3d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:04.063348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e51f2967-dfae-46f8-adc6-0aed4a79a3d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:04.071195 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e51f2967-dfae-46f8-adc6-0aed4a79a3d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:04.072640 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e51f2967-dfae-46f8-adc6-0aed4a79a3d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:04.073738 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e51f2967-dfae-46f8-adc6-0aed4a79a3d1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.154617 May 10 20:04:04.074307 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 350/720] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:03 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:04.360636 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3676f06f-6f86-4d7c-b944-7559e044b39f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:04.361153 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3676f06f-6f86-4d7c-b944-7559e044b39f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:04.368873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3676f06f-6f86-4d7c-b944-7559e044b39f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:04.369334 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3676f06f-6f86-4d7c-b944-7559e044b39f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:04.370110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3676f06f-6f86-4d7c-b944-7559e044b39f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:04.370585 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3676f06f-6f86-4d7c-b944-7559e044b39f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:04.465938 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-56e8474e-59cc-48a7-973e-c74954d6a4de tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:04.466860 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-56e8474e-59cc-48a7-973e-c74954d6a4de tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:04.472716 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-56e8474e-59cc-48a7-973e-c74954d6a4de tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:04.473244 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-56e8474e-59cc-48a7-973e-c74954d6a4de tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:04.474076 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-56e8474e-59cc-48a7-973e-c74954d6a4de tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:04.474545 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-56e8474e-59cc-48a7-973e-c74954d6a4de tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:04.497272 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3676f06f-6f86-4d7c-b944-7559e044b39f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:04.504635 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3676f06f-6f86-4d7c-b944-7559e044b39f tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.147954 May 10 20:04:04.505216 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 371/721] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:04 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:04.601387 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-56e8474e-59cc-48a7-973e-c74954d6a4de tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:04.608814 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-56e8474e-59cc-48a7-973e-c74954d6a4de tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.146659 May 10 20:04:04.609449 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 351/722] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:04 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:04:05.091293 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-496ad4f6-9881-4f71-b92a-5fed6c5a8073 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:05.091991 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-496ad4f6-9881-4f71-b92a-5fed6c5a8073 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:05.097787 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-496ad4f6-9881-4f71-b92a-5fed6c5a8073 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:05.098235 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-496ad4f6-9881-4f71-b92a-5fed6c5a8073 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:05.099025 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-496ad4f6-9881-4f71-b92a-5fed6c5a8073 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:05.099461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-496ad4f6-9881-4f71-b92a-5fed6c5a8073 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:05.230027 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-496ad4f6-9881-4f71-b92a-5fed6c5a8073 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:05.237817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-496ad4f6-9881-4f71-b92a-5fed6c5a8073 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:05.239410 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-496ad4f6-9881-4f71-b92a-5fed6c5a8073 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:05.240777 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-496ad4f6-9881-4f71-b92a-5fed6c5a8073 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.153380 May 10 20:04:05.241406 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 372/723] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:05 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:05.521810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-810c9b0f-5eeb-4469-8d90-78794069be34 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:05.522600 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-810c9b0f-5eeb-4469-8d90-78794069be34 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:05.529224 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-810c9b0f-5eeb-4469-8d90-78794069be34 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:05.529414 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-810c9b0f-5eeb-4469-8d90-78794069be34 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:05.530188 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-810c9b0f-5eeb-4469-8d90-78794069be34 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:05.530667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-810c9b0f-5eeb-4469-8d90-78794069be34 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:05.628187 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d0550e96-e7d9-4947-9fbc-4a98bac3408a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:05.628889 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d0550e96-e7d9-4947-9fbc-4a98bac3408a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:05.635226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0550e96-e7d9-4947-9fbc-4a98bac3408a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:05.635769 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0550e96-e7d9-4947-9fbc-4a98bac3408a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:05.636599 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0550e96-e7d9-4947-9fbc-4a98bac3408a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:05.637102 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0550e96-e7d9-4947-9fbc-4a98bac3408a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:05.661655 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-810c9b0f-5eeb-4469-8d90-78794069be34 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:05.671933 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-810c9b0f-5eeb-4469-8d90-78794069be34 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.153940 May 10 20:04:05.672522 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 352/724] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:05 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:05.766349 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d0550e96-e7d9-4947-9fbc-4a98bac3408a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:05.774648 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d0550e96-e7d9-4947-9fbc-4a98bac3408a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.150195 May 10 20:04:05.775237 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 373/725] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:05 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:04:06.259585 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-04284263-7b80-48f5-b018-9cf77622eb38 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:06.260198 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-04284263-7b80-48f5-b018-9cf77622eb38 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:06.266138 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04284263-7b80-48f5-b018-9cf77622eb38 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:06.266625 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04284263-7b80-48f5-b018-9cf77622eb38 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:06.267388 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04284263-7b80-48f5-b018-9cf77622eb38 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:06.267828 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04284263-7b80-48f5-b018-9cf77622eb38 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:06.391533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-04284263-7b80-48f5-b018-9cf77622eb38 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:06.399171 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-04284263-7b80-48f5-b018-9cf77622eb38 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:06.400672 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-04284263-7b80-48f5-b018-9cf77622eb38 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:06.401771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-04284263-7b80-48f5-b018-9cf77622eb38 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.146592 May 10 20:04:06.402335 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 353/726] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:06 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:06.688693 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7b97b94e-75ac-4187-a00c-f61db8ddebb9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:06.689306 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7b97b94e-75ac-4187-a00c-f61db8ddebb9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:06.696297 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b97b94e-75ac-4187-a00c-f61db8ddebb9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:06.696748 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b97b94e-75ac-4187-a00c-f61db8ddebb9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:06.697522 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b97b94e-75ac-4187-a00c-f61db8ddebb9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:06.697966 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b97b94e-75ac-4187-a00c-f61db8ddebb9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:06.791806 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3a51ed3e-45d5-4f71-b906-46a07809e129 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:06.792416 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3a51ed3e-45d5-4f71-b906-46a07809e129 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:06.799036 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3a51ed3e-45d5-4f71-b906-46a07809e129 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:06.799488 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3a51ed3e-45d5-4f71-b906-46a07809e129 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:06.800259 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3a51ed3e-45d5-4f71-b906-46a07809e129 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:06.800694 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3a51ed3e-45d5-4f71-b906-46a07809e129 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:06.830761 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7b97b94e-75ac-4187-a00c-f61db8ddebb9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:06.838215 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7b97b94e-75ac-4187-a00c-f61db8ddebb9 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.153377 May 10 20:04:06.838821 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 374/727] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:06 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:06.928307 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3a51ed3e-45d5-4f71-b906-46a07809e129 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:06.936169 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3a51ed3e-45d5-4f71-b906-46a07809e129 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.148722 May 10 20:04:06.936779 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 354/728] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:06 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:07.329801 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-d7d26aa3-874c-4a14-84fd-41ce78bfedf6 req-65aae1de-e5a7-46ed-adf6-4e0f9bb2d66c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ba59142-196f-4c2d-9795-fdeba5da92e3", "name": "network-vif-plugged", "status": "completed", "tag": "b394e984-72e7-4807-85f2-d6717d5ed1e4"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:07.340712 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-d7d26aa3-874c-4a14-84fd-41ce78bfedf6 req-65aae1de-e5a7-46ed-adf6-4e0f9bb2d66c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:07.341158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-d7d26aa3-874c-4a14-84fd-41ce78bfedf6 req-65aae1de-e5a7-46ed-adf6-4e0f9bb2d66c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:07.353186 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-d7d26aa3-874c-4a14-84fd-41ce78bfedf6 req-65aae1de-e5a7-46ed-adf6-4e0f9bb2d66c service nova] Creating event network-vif-plugged:b394e984-72e7-4807-85f2-d6717d5ed1e4 for instance 6ba59142-196f-4c2d-9795-fdeba5da92e3 on hv-cinder-84131 May 10 20:04:07.358182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-d7d26aa3-874c-4a14-84fd-41ce78bfedf6 req-65aae1de-e5a7-46ed-adf6-4e0f9bb2d66c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032082 May 10 20:04:07.358908 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 375/729] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:04:07.420191 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a5447e48-4561-4842-98df-03cd7d96b0f3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:07.420803 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a5447e48-4561-4842-98df-03cd7d96b0f3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:07.426942 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a5447e48-4561-4842-98df-03cd7d96b0f3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:07.427397 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a5447e48-4561-4842-98df-03cd7d96b0f3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:07.428174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a5447e48-4561-4842-98df-03cd7d96b0f3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:07.428612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a5447e48-4561-4842-98df-03cd7d96b0f3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:07.586599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a5447e48-4561-4842-98df-03cd7d96b0f3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:07.596417 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a5447e48-4561-4842-98df-03cd7d96b0f3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:07.598740 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a5447e48-4561-4842-98df-03cd7d96b0f3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:07.600552 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a5447e48-4561-4842-98df-03cd7d96b0f3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.183769 May 10 20:04:07.601769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 355/730] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:07 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:07.856071 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cf12212d-b597-4f3e-ad9f-a96312ff9f60 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:07.856697 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cf12212d-b597-4f3e-ad9f-a96312ff9f60 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:07.862844 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf12212d-b597-4f3e-ad9f-a96312ff9f60 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:07.863301 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf12212d-b597-4f3e-ad9f-a96312ff9f60 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:07.864081 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf12212d-b597-4f3e-ad9f-a96312ff9f60 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:07.864783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf12212d-b597-4f3e-ad9f-a96312ff9f60 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:07.952754 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-14e0872f-eb3c-4c81-906a-7f92a45386db tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:07.953371 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-14e0872f-eb3c-4c81-906a-7f92a45386db tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:07.959660 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-14e0872f-eb3c-4c81-906a-7f92a45386db tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:07.960119 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-14e0872f-eb3c-4c81-906a-7f92a45386db tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:07.960899 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-14e0872f-eb3c-4c81-906a-7f92a45386db tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:07.961345 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-14e0872f-eb3c-4c81-906a-7f92a45386db tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:07.994728 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cf12212d-b597-4f3e-ad9f-a96312ff9f60 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:08.001993 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cf12212d-b597-4f3e-ad9f-a96312ff9f60 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.150994 May 10 20:04:08.002601 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 376/731] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:07 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:08.088020 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-14e0872f-eb3c-4c81-906a-7f92a45386db tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:08.095339 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-14e0872f-eb3c-4c81-906a-7f92a45386db tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.146419 May 10 20:04:08.095911 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 356/732] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:07 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:04:08.621949 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c2f1857c-a8d6-46a5-a474-eb032678b7e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:08.622607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c2f1857c-a8d6-46a5-a474-eb032678b7e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:08.628592 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2f1857c-a8d6-46a5-a474-eb032678b7e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:08.629045 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2f1857c-a8d6-46a5-a474-eb032678b7e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:08.629810 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2f1857c-a8d6-46a5-a474-eb032678b7e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:08.630254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2f1857c-a8d6-46a5-a474-eb032678b7e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:08.755508 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c2f1857c-a8d6-46a5-a474-eb032678b7e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:08.763868 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c2f1857c-a8d6-46a5-a474-eb032678b7e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:08.765423 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c2f1857c-a8d6-46a5-a474-eb032678b7e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:08.766583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c2f1857c-a8d6-46a5-a474-eb032678b7e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.148676 May 10 20:04:08.767155 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 377/733] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:08 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:09.019340 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-02c08e3f-3ae6-4370-bb11-1290005569de tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:09.019945 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-02c08e3f-3ae6-4370-bb11-1290005569de tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:09.026873 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-02c08e3f-3ae6-4370-bb11-1290005569de tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:09.027285 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-02c08e3f-3ae6-4370-bb11-1290005569de tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:09.028050 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-02c08e3f-3ae6-4370-bb11-1290005569de tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:09.028486 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-02c08e3f-3ae6-4370-bb11-1290005569de tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:09.112914 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0cb7fd71-7766-4326-a17d-018b41ed6ebf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:09.114708 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0cb7fd71-7766-4326-a17d-018b41ed6ebf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:09.127136 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0cb7fd71-7766-4326-a17d-018b41ed6ebf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:09.128156 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0cb7fd71-7766-4326-a17d-018b41ed6ebf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:09.138764 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0cb7fd71-7766-4326-a17d-018b41ed6ebf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:09.139223 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0cb7fd71-7766-4326-a17d-018b41ed6ebf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:09.199253 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-02c08e3f-3ae6-4370-bb11-1290005569de tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:09.209030 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-02c08e3f-3ae6-4370-bb11-1290005569de tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1264 microversion: 2.1 time: 0.193376 May 10 20:04:09.214511 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 357/734] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:09 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:09.297758 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0cb7fd71-7766-4326-a17d-018b41ed6ebf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:09.305566 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0cb7fd71-7766-4326-a17d-018b41ed6ebf tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.197157 May 10 20:04:09.306138 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 378/735] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:09 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:04:09.376013 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-4c03dad4-dac4-4dec-b45e-a434bd72f88c req-452e779c-0c99-44ff-b6d1-f1d92b9c1c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2268fb12-3e45-4d7c-bb6a-c59e140dc79f", "name": "network-vif-plugged", "status": "completed", "tag": "34dbba1c-4e73-4f41-96f8-80ce28c99512"}, {"server_uuid": "54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5", "name": "network-vif-plugged", "status": "completed", "tag": "ce79326e-c370-40ae-ba6d-04bd30bc39a2"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:09.385049 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4c03dad4-dac4-4dec-b45e-a434bd72f88c req-452e779c-0c99-44ff-b6d1-f1d92b9c1c15 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:09.385493 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4c03dad4-dac4-4dec-b45e-a434bd72f88c req-452e779c-0c99-44ff-b6d1-f1d92b9c1c15 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:09.397117 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-4c03dad4-dac4-4dec-b45e-a434bd72f88c req-452e779c-0c99-44ff-b6d1-f1d92b9c1c15 service nova] Creating event network-vif-plugged:34dbba1c-4e73-4f41-96f8-80ce28c99512 for instance 2268fb12-3e45-4d7c-bb6a-c59e140dc79f on hv-cinder-84131 May 10 20:04:09.398201 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-4c03dad4-dac4-4dec-b45e-a434bd72f88c req-452e779c-0c99-44ff-b6d1-f1d92b9c1c15 service nova] Creating event network-vif-plugged:ce79326e-c370-40ae-ba6d-04bd30bc39a2 for instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 on hv-cinder-84131 May 10 20:04:09.404663 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-4c03dad4-dac4-4dec-b45e-a434bd72f88c req-452e779c-0c99-44ff-b6d1-f1d92b9c1c15 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032533 May 10 20:04:09.405249 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 358/736] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:04:09.785018 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-246c9bec-cb7a-4c0a-9362-b5764991b131 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:09.785627 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-246c9bec-cb7a-4c0a-9362-b5764991b131 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:09.791511 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-246c9bec-cb7a-4c0a-9362-b5764991b131 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:09.792009 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-246c9bec-cb7a-4c0a-9362-b5764991b131 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:09.792750 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-246c9bec-cb7a-4c0a-9362-b5764991b131 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:09.793166 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-246c9bec-cb7a-4c0a-9362-b5764991b131 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:09.916898 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-246c9bec-cb7a-4c0a-9362-b5764991b131 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:09.924768 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-246c9bec-cb7a-4c0a-9362-b5764991b131 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:09.926162 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-246c9bec-cb7a-4c0a-9362-b5764991b131 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:09.927280 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-246c9bec-cb7a-4c0a-9362-b5764991b131 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.146353 May 10 20:04:09.927844 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 379/737] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:09 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:10.226960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0426e36f-9f03-468c-81c0-347ccd27d11b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:10.227724 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0426e36f-9f03-468c-81c0-347ccd27d11b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:10.234240 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0426e36f-9f03-468c-81c0-347ccd27d11b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:10.234735 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0426e36f-9f03-468c-81c0-347ccd27d11b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:10.235511 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0426e36f-9f03-468c-81c0-347ccd27d11b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:10.235962 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0426e36f-9f03-468c-81c0-347ccd27d11b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:10.323176 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2b2faec2-2a44-4ac3-8c39-706c09ba217a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:10.323857 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2b2faec2-2a44-4ac3-8c39-706c09ba217a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:10.330564 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b2faec2-2a44-4ac3-8c39-706c09ba217a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:10.331046 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b2faec2-2a44-4ac3-8c39-706c09ba217a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:10.331817 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b2faec2-2a44-4ac3-8c39-706c09ba217a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:10.332252 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b2faec2-2a44-4ac3-8c39-706c09ba217a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:10.375853 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0426e36f-9f03-468c-81c0-347ccd27d11b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:10.383761 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0426e36f-9f03-468c-81c0-347ccd27d11b tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1451 microversion: 2.1 time: 0.161141 May 10 20:04:10.384342 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 359/738] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:10 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:10.399718 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4f3777ad-6095-4cd1-b6ac-198a866644e7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:10.400444 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4f3777ad-6095-4cd1-b6ac-198a866644e7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:10.406191 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f3777ad-6095-4cd1-b6ac-198a866644e7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:10.406683 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f3777ad-6095-4cd1-b6ac-198a866644e7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:10.407452 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f3777ad-6095-4cd1-b6ac-198a866644e7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:10.407893 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f3777ad-6095-4cd1-b6ac-198a866644e7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:10.463103 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2b2faec2-2a44-4ac3-8c39-706c09ba217a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:10.470217 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2b2faec2-2a44-4ac3-8c39-706c09ba217a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.151757 May 10 20:04:10.470878 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 380/739] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:10 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:04:10.534579 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4f3777ad-6095-4cd1-b6ac-198a866644e7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:10.541803 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4f3777ad-6095-4cd1-b6ac-198a866644e7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1451 microversion: 2.1 time: 0.145729 May 10 20:04:10.542383 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 360/740] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:10 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:04:10.946960 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9bd6ec0a-9ff2-4ca5-885d-2b7e13327faf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:10.947680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9bd6ec0a-9ff2-4ca5-885d-2b7e13327faf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:10.955442 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9bd6ec0a-9ff2-4ca5-885d-2b7e13327faf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:10.956069 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9bd6ec0a-9ff2-4ca5-885d-2b7e13327faf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:10.957713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9bd6ec0a-9ff2-4ca5-885d-2b7e13327faf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:10.957713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9bd6ec0a-9ff2-4ca5-885d-2b7e13327faf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:11.095558 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9bd6ec0a-9ff2-4ca5-885d-2b7e13327faf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:11.103588 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9bd6ec0a-9ff2-4ca5-885d-2b7e13327faf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:11.105092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9bd6ec0a-9ff2-4ca5-885d-2b7e13327faf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:11.106192 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9bd6ec0a-9ff2-4ca5-885d-2b7e13327faf tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.165044 May 10 20:04:11.106803 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 381/741] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:10 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:11.487198 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-35d48e20-8f2a-498c-ad50-a7dd9af8e217 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:11.487846 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-35d48e20-8f2a-498c-ad50-a7dd9af8e217 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:11.495434 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-35d48e20-8f2a-498c-ad50-a7dd9af8e217 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:11.495886 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-35d48e20-8f2a-498c-ad50-a7dd9af8e217 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:11.496672 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-35d48e20-8f2a-498c-ad50-a7dd9af8e217 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:11.497116 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-35d48e20-8f2a-498c-ad50-a7dd9af8e217 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:11.769964 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-35d48e20-8f2a-498c-ad50-a7dd9af8e217 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:11.778203 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-35d48e20-8f2a-498c-ad50-a7dd9af8e217 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.294876 May 10 20:04:11.778812 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 361/742] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:11 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:12.125139 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1a02c52f-837c-4c7d-9451-c2be8205e4fa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:12.125769 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1a02c52f-837c-4c7d-9451-c2be8205e4fa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:12.132594 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a02c52f-837c-4c7d-9451-c2be8205e4fa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:12.133041 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a02c52f-837c-4c7d-9451-c2be8205e4fa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:12.133804 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a02c52f-837c-4c7d-9451-c2be8205e4fa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:12.134255 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a02c52f-837c-4c7d-9451-c2be8205e4fa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:12.262335 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1a02c52f-837c-4c7d-9451-c2be8205e4fa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:12.270206 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1a02c52f-837c-4c7d-9451-c2be8205e4fa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:12.271676 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1a02c52f-837c-4c7d-9451-c2be8205e4fa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:12.273377 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1a02c52f-837c-4c7d-9451-c2be8205e4fa tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.152272 May 10 20:04:12.273946 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 382/743] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:12 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:12.520787 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-810df3f1-1598-48ad-89e7-d0ffb9647222 req-93d9e601-f41e-4085-8f51-19c3220f5e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ba59142-196f-4c2d-9795-fdeba5da92e3", "tag": "b394e984-72e7-4807-85f2-d6717d5ed1e4"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:12.529350 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-810df3f1-1598-48ad-89e7-d0ffb9647222 req-93d9e601-f41e-4085-8f51-19c3220f5e90 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:12.529880 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-810df3f1-1598-48ad-89e7-d0ffb9647222 req-93d9e601-f41e-4085-8f51-19c3220f5e90 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:12.540852 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-810df3f1-1598-48ad-89e7-d0ffb9647222 req-93d9e601-f41e-4085-8f51-19c3220f5e90 service nova] Creating event network-changed:b394e984-72e7-4807-85f2-d6717d5ed1e4 for instance 6ba59142-196f-4c2d-9795-fdeba5da92e3 on hv-cinder-84131 May 10 20:04:12.546276 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-810df3f1-1598-48ad-89e7-d0ffb9647222 req-93d9e601-f41e-4085-8f51-19c3220f5e90 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029395 May 10 20:04:12.546920 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 362/744] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:04:12.795072 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ddd85fba-7938-43fe-93ce-51ec069df075 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:12.795610 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ddd85fba-7938-43fe-93ce-51ec069df075 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:12.801550 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ddd85fba-7938-43fe-93ce-51ec069df075 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:12.802006 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ddd85fba-7938-43fe-93ce-51ec069df075 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:12.802851 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ddd85fba-7938-43fe-93ce-51ec069df075 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:12.803292 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ddd85fba-7938-43fe-93ce-51ec069df075 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:12.933638 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ddd85fba-7938-43fe-93ce-51ec069df075 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:12.941335 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ddd85fba-7938-43fe-93ce-51ec069df075 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.150153 May 10 20:04:12.941937 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 383/745] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:12 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:13.292149 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4d4395b0-887f-4b4f-b7eb-5bb8f86f99f9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:13.292853 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4d4395b0-887f-4b4f-b7eb-5bb8f86f99f9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:13.299093 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d4395b0-887f-4b4f-b7eb-5bb8f86f99f9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:13.299489 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d4395b0-887f-4b4f-b7eb-5bb8f86f99f9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:13.300267 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d4395b0-887f-4b4f-b7eb-5bb8f86f99f9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:13.300709 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d4395b0-887f-4b4f-b7eb-5bb8f86f99f9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:13.436147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4d4395b0-887f-4b4f-b7eb-5bb8f86f99f9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:13.444821 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4d4395b0-887f-4b4f-b7eb-5bb8f86f99f9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:13.446372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4d4395b0-887f-4b4f-b7eb-5bb8f86f99f9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:13.447638 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4d4395b0-887f-4b4f-b7eb-5bb8f86f99f9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.160343 May 10 20:04:13.448214 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 363/746] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:13 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:13.958606 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ca5a1390-6708-4625-a407-377f3ea0861e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:13.959226 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ca5a1390-6708-4625-a407-377f3ea0861e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:13.965660 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ca5a1390-6708-4625-a407-377f3ea0861e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:13.966121 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ca5a1390-6708-4625-a407-377f3ea0861e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:13.966930 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ca5a1390-6708-4625-a407-377f3ea0861e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:13.967373 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ca5a1390-6708-4625-a407-377f3ea0861e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:14.099167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ca5a1390-6708-4625-a407-377f3ea0861e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:14.106421 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ca5a1390-6708-4625-a407-377f3ea0861e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1315 microversion: 2.1 time: 0.151769 May 10 20:04:14.107008 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 384/747] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:13 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:14.465502 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-33a45fb5-f7b6-424f-855a-8ed3779a8a0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:14.466112 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-33a45fb5-f7b6-424f-855a-8ed3779a8a0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:14.472504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-33a45fb5-f7b6-424f-855a-8ed3779a8a0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:14.472955 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-33a45fb5-f7b6-424f-855a-8ed3779a8a0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:14.473716 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-33a45fb5-f7b6-424f-855a-8ed3779a8a0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:14.474149 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-33a45fb5-f7b6-424f-855a-8ed3779a8a0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:14.599598 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-33a45fb5-f7b6-424f-855a-8ed3779a8a0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:14.608034 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-33a45fb5-f7b6-424f-855a-8ed3779a8a0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:14.609543 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-33a45fb5-f7b6-424f-855a-8ed3779a8a0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:14.610689 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-33a45fb5-f7b6-424f-855a-8ed3779a8a0c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1406 microversion: 2.20 time: 0.149137 May 10 20:04:14.611258 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 364/748] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:14 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:15.121988 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fdca34b5-964f-4f78-a1bc-ed23d8be891e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:15.122660 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fdca34b5-964f-4f78-a1bc-ed23d8be891e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:15.129575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdca34b5-964f-4f78-a1bc-ed23d8be891e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:15.130029 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdca34b5-964f-4f78-a1bc-ed23d8be891e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:15.130829 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdca34b5-964f-4f78-a1bc-ed23d8be891e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:15.131269 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdca34b5-964f-4f78-a1bc-ed23d8be891e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:15.268459 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fdca34b5-964f-4f78-a1bc-ed23d8be891e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:15.277876 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fdca34b5-964f-4f78-a1bc-ed23d8be891e tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1464 microversion: 2.1 time: 0.159637 May 10 20:04:15.286607 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 385/749] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:15 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:15.317878 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-df8d7694-188e-49be-aa9d-fe1be2b7a8ef tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:15.318390 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-df8d7694-188e-49be-aa9d-fe1be2b7a8ef tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:15.324821 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df8d7694-188e-49be-aa9d-fe1be2b7a8ef tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:15.325279 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df8d7694-188e-49be-aa9d-fe1be2b7a8ef tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:15.326053 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df8d7694-188e-49be-aa9d-fe1be2b7a8ef tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:15.326522 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df8d7694-188e-49be-aa9d-fe1be2b7a8ef tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:15.351500 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-df8d7694-188e-49be-aa9d-fe1be2b7a8ef tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:04:15.432021 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-df8d7694-188e-49be-aa9d-fe1be2b7a8ef tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 204 len: 0 microversion: 2.1 time: 0.117775 May 10 20:04:15.436097 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 365/750] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:04:15 2022] DELETE /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:04:15.442026 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-87e4c4d0-7ce0-4582-adbe-87c5e17c755a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:15.442669 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-87e4c4d0-7ce0-4582-adbe-87c5e17c755a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:15.449017 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87e4c4d0-7ce0-4582-adbe-87c5e17c755a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:15.449474 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87e4c4d0-7ce0-4582-adbe-87c5e17c755a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:15.450239 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87e4c4d0-7ce0-4582-adbe-87c5e17c755a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:15.450739 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-87e4c4d0-7ce0-4582-adbe-87c5e17c755a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:15.577118 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-87e4c4d0-7ce0-4582-adbe-87c5e17c755a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:15.584335 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-87e4c4d0-7ce0-4582-adbe-87c5e17c755a tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1470 microversion: 2.1 time: 0.146428 May 10 20:04:15.584915 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 386/751] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:15 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:04:15.629575 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9ab4d032-299c-4745-a8e0-366a749682ea tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:15.630283 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9ab4d032-299c-4745-a8e0-366a749682ea tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:15.638684 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9ab4d032-299c-4745-a8e0-366a749682ea tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:15.639435 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9ab4d032-299c-4745-a8e0-366a749682ea tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:15.640231 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9ab4d032-299c-4745-a8e0-366a749682ea tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:15.640676 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9ab4d032-299c-4745-a8e0-366a749682ea tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:15.771316 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9ab4d032-299c-4745-a8e0-366a749682ea tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:15.779120 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9ab4d032-299c-4745-a8e0-366a749682ea tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:15.780534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9ab4d032-299c-4745-a8e0-366a749682ea tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:15.781679 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9ab4d032-299c-4745-a8e0-366a749682ea tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1598 microversion: 2.20 time: 0.156518 May 10 20:04:15.782243 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 366/752] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:04:15 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:04:15.800473 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9a34090d-c61b-48c3-936f-af7d5fdfc6ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:15.800980 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9a34090d-c61b-48c3-936f-af7d5fdfc6ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:15.807945 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9a34090d-c61b-48c3-936f-af7d5fdfc6ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:15.808405 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9a34090d-c61b-48c3-936f-af7d5fdfc6ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:15.809178 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9a34090d-c61b-48c3-936f-af7d5fdfc6ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:15.809622 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9a34090d-c61b-48c3-936f-af7d5fdfc6ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:15.883761 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9a34090d-c61b-48c3-936f-af7d5fdfc6ac tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087157 May 10 20:04:15.884365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 387/753] 10.222.0.57 () {60 vars in 1315 bytes} [Tue May 10 20:04:15 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:04:16.601285 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e5596ebb-2abf-4464-9ad4-b57b23efa7c7 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:16.601838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e5596ebb-2abf-4464-9ad4-b57b23efa7c7 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:16.607604 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e5596ebb-2abf-4464-9ad4-b57b23efa7c7 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:16.608053 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e5596ebb-2abf-4464-9ad4-b57b23efa7c7 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:16.608810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e5596ebb-2abf-4464-9ad4-b57b23efa7c7 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:16.609245 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e5596ebb-2abf-4464-9ad4-b57b23efa7c7 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:16.740016 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e5596ebb-2abf-4464-9ad4-b57b23efa7c7 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:16.748148 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e5596ebb-2abf-4464-9ad4-b57b23efa7c7 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1470 microversion: 2.1 time: 0.150836 May 10 20:04:16.748742 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 367/754] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:16 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:17.113373 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-278f70e3-0a39-47fb-9eaf-bbdf2cdde834 req-5e103034-5f23-4f08-8d19-9fa82b29c40c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5", "tag": "ce79326e-c370-40ae-ba6d-04bd30bc39a2"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:17.122097 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-278f70e3-0a39-47fb-9eaf-bbdf2cdde834 req-5e103034-5f23-4f08-8d19-9fa82b29c40c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:17.122570 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-278f70e3-0a39-47fb-9eaf-bbdf2cdde834 req-5e103034-5f23-4f08-8d19-9fa82b29c40c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:17.134124 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-278f70e3-0a39-47fb-9eaf-bbdf2cdde834 req-5e103034-5f23-4f08-8d19-9fa82b29c40c service nova] Creating event network-changed:ce79326e-c370-40ae-ba6d-04bd30bc39a2 for instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 on hv-cinder-84131 May 10 20:04:17.139194 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-278f70e3-0a39-47fb-9eaf-bbdf2cdde834 req-5e103034-5f23-4f08-8d19-9fa82b29c40c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087297 May 10 20:04:17.139998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 388/755] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:04:17.767738 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4475c13f-2cf3-41d1-be09-d697e71c60e8 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:17.768459 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4475c13f-2cf3-41d1-be09-d697e71c60e8 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:17.777950 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4475c13f-2cf3-41d1-be09-d697e71c60e8 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:17.778723 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4475c13f-2cf3-41d1-be09-d697e71c60e8 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:17.780031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4475c13f-2cf3-41d1-be09-d697e71c60e8 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:17.780605 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4475c13f-2cf3-41d1-be09-d697e71c60e8 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:17.910695 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4475c13f-2cf3-41d1-be09-d697e71c60e8 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:17.918991 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4475c13f-2cf3-41d1-be09-d697e71c60e8 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1470 microversion: 2.1 time: 0.156018 May 10 20:04:17.919596 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 368/756] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:17 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:18.937110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e22f0a52-a277-4950-8f11-b5997e8de7e1 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:18.938061 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e22f0a52-a277-4950-8f11-b5997e8de7e1 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:18.944966 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e22f0a52-a277-4950-8f11-b5997e8de7e1 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:18.945592 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e22f0a52-a277-4950-8f11-b5997e8de7e1 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:18.946364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e22f0a52-a277-4950-8f11-b5997e8de7e1 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:18.946828 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e22f0a52-a277-4950-8f11-b5997e8de7e1 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:19.239641 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e22f0a52-a277-4950-8f11-b5997e8de7e1 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:19.243920 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-5408ae00-2d1d-4813-b4a1-fcdb9280d4aa req-7b8dd0b5-de19-458f-9115-5c4daaec05bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2268fb12-3e45-4d7c-bb6a-c59e140dc79f", "name": "network-vif-deleted", "tag": "34dbba1c-4e73-4f41-96f8-80ce28c99512"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:19.260205 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e22f0a52-a277-4950-8f11-b5997e8de7e1 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1470 microversion: 2.1 time: 0.327754 May 10 20:04:19.262818 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-5408ae00-2d1d-4813-b4a1-fcdb9280d4aa req-7b8dd0b5-de19-458f-9115-5c4daaec05bc service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:19.263643 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 389/757] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:18 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1470 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:19.264296 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-5408ae00-2d1d-4813-b4a1-fcdb9280d4aa req-7b8dd0b5-de19-458f-9115-5c4daaec05bc service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:19.276999 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-5408ae00-2d1d-4813-b4a1-fcdb9280d4aa req-7b8dd0b5-de19-458f-9115-5c4daaec05bc service nova] Creating event network-vif-deleted:34dbba1c-4e73-4f41-96f8-80ce28c99512 for instance 2268fb12-3e45-4d7c-bb6a-c59e140dc79f on hv-cinder-84131 May 10 20:04:19.283369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-5408ae00-2d1d-4813-b4a1-fcdb9280d4aa req-7b8dd0b5-de19-458f-9115-5c4daaec05bc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049065 May 10 20:04:19.286526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 369/758] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:04:20.281092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5175eec4-d979-481d-bc53-485f920b6825 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:20.281617 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5175eec4-d979-481d-bc53-485f920b6825 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:20.288502 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5175eec4-d979-481d-bc53-485f920b6825 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:20.288957 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5175eec4-d979-481d-bc53-485f920b6825 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:20.289723 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5175eec4-d979-481d-bc53-485f920b6825 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:20.290162 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5175eec4-d979-481d-bc53-485f920b6825 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:20.321340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5175eec4-d979-481d-bc53-485f920b6825 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:20.321789 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5175eec4-d979-481d-bc53-485f920b6825 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:20.322236 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-5175eec4-d979-481d-bc53-485f920b6825 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lazy-loading 'fault' on Instance uuid 2268fb12-3e45-4d7c-bb6a-c59e140dc79f {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:04:20.361054 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5175eec4-d979-481d-bc53-485f920b6825 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:20.369372 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5175eec4-d979-481d-bc53-485f920b6825 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1305 microversion: 2.1 time: 0.092542 May 10 20:04:20.369954 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 390/759] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:20 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:21.388069 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9285e2c0-1fae-44dc-9ed7-3f1ea1a438fd tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:21.388765 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9285e2c0-1fae-44dc-9ed7-3f1ea1a438fd tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:21.394785 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9285e2c0-1fae-44dc-9ed7-3f1ea1a438fd tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:21.395233 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9285e2c0-1fae-44dc-9ed7-3f1ea1a438fd tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:21.395989 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9285e2c0-1fae-44dc-9ed7-3f1ea1a438fd tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:21.396467 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9285e2c0-1fae-44dc-9ed7-3f1ea1a438fd tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:21.427394 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9285e2c0-1fae-44dc-9ed7-3f1ea1a438fd tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:21.427838 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9285e2c0-1fae-44dc-9ed7-3f1ea1a438fd tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:21.428934 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-9285e2c0-1fae-44dc-9ed7-3f1ea1a438fd tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lazy-loading 'fault' on Instance uuid 2268fb12-3e45-4d7c-bb6a-c59e140dc79f {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:04:21.469180 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9285e2c0-1fae-44dc-9ed7-3f1ea1a438fd tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:21.476364 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9285e2c0-1fae-44dc-9ed7-3f1ea1a438fd tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1305 microversion: 2.1 time: 0.093083 May 10 20:04:21.476925 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 370/760] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:21 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:22.493235 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-86c12442-d3af-4cf1-b6e4-5ae297c7ebce tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:22.493854 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-86c12442-d3af-4cf1-b6e4-5ae297c7ebce tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:22.500089 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-86c12442-d3af-4cf1-b6e4-5ae297c7ebce tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:22.500548 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-86c12442-d3af-4cf1-b6e4-5ae297c7ebce tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:22.501586 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-86c12442-d3af-4cf1-b6e4-5ae297c7ebce tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:22.502033 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-86c12442-d3af-4cf1-b6e4-5ae297c7ebce tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:22.533691 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-86c12442-d3af-4cf1-b6e4-5ae297c7ebce tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:22.534148 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-86c12442-d3af-4cf1-b6e4-5ae297c7ebce tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:22.534658 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-86c12442-d3af-4cf1-b6e4-5ae297c7ebce tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lazy-loading 'fault' on Instance uuid 2268fb12-3e45-4d7c-bb6a-c59e140dc79f {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:04:22.578019 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-86c12442-d3af-4cf1-b6e4-5ae297c7ebce tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274e6e1e975f45ad92a18f88094b414a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7812c5045988421aa82845f73e66b2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:22.585894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-86c12442-d3af-4cf1-b6e4-5ae297c7ebce tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 200 len: 1305 microversion: 2.1 time: 0.096847 May 10 20:04:22.586480 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 391/761] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:22 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:23.602684 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2cfaf76d-3fd0-4d89-ace2-db213ab31962 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:23.603315 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2cfaf76d-3fd0-4d89-ace2-db213ab31962 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] [instance: 2268fb12-3e45-4d7c-bb6a-c59e140dc79f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:23.609744 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cfaf76d-3fd0-4d89-ace2-db213ab31962 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:23.610274 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cfaf76d-3fd0-4d89-ace2-db213ab31962 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:23.611174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cfaf76d-3fd0-4d89-ace2-db213ab31962 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:23.611637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cfaf76d-3fd0-4d89-ace2-db213ab31962 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:23.628271 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-2cfaf76d-3fd0-4d89-ace2-db213ab31962 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] HTTP exception thrown: Instance 2268fb12-3e45-4d7c-bb6a-c59e140dc79f could not be found. May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2cfaf76d-3fd0-4d89-ace2-db213ab31962 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Request method failure captured: May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f HTTP/1.1 May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesUqjevt8RIFB9_FJ7EPI9qAocLfN3ITGmegoxDg8u2ukqsZVgh1KBZhzKRdUG-vOVQ7mQwp5vVrFVepkgsJ-WRM1Th0-oayNM1CKrzu7pi7U8T0c7OWZMakh9XBov9-1b582BQrsojV_33RqklkC5RuIqJt19mwKb-s8Sy5Ray2wIc May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 7812c5045988421aa82845f73e66b2a1 May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-VolumesNegativeTest-1724850600 May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:04:23.629931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7812c5045988421aa82845f73e66b2a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7812c5045988421aa82845f73e66b2a1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7812c5045988421aa82845f73e66b2a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7812c5045988421aa82845f73e66b2a1"}]}] May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-VolumesNegativeTest-1724850600 May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 7812c5045988421aa82845f73e66b2a1 May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-VolumesNegativeTest-1724850600 May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-VolumesNegativeTest-1724850600-project May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 274e6e1e975f45ad92a18f88094b414a May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-VolumesNegativeTest-1724850600-project May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 2268fb12-3e45-4d7c-bb6a-c59e140dc79f could not be found. May 10 20:04:23.631979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '2268fb12-3e45-4d7c-bb6a-c59e140dc79f'} May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2268fb12-3e45-4d7c-bb6a-c59e140dc79f could not be found. May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:04:23.632841 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2268fb12-3e45-4d7c-bb6a-c59e140dc79f could not be found. May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2268fb12-3e45-4d7c-bb6a-c59e140dc79f could not be found. May 10 20:04:23.634165 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:04:23.635453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2cfaf76d-3fd0-4d89-ace2-db213ab31962 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] Returning 404 to user: Instance 2268fb12-3e45-4d7c-bb6a-c59e140dc79f could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:04:23.635453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2cfaf76d-3fd0-4d89-ace2-db213ab31962 tempest-VolumesNegativeTest-1724850600 tempest-VolumesNegativeTest-1724850600-project] 10.222.0.57 "GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f" status: 404 len: 111 microversion: 2.1 time: 0.032615 May 10 20:04:23.635453 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 371/762] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:23 2022] GET /compute/v2.1/servers/2268fb12-3e45-4d7c-bb6a-c59e140dc79f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:04:27.000682 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-05fbc3fc-da8f-4c57-8ce1-7bb3e4815844 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:27.001182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-05fbc3fc-da8f-4c57-8ce1-7bb3e4815844 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:27.007997 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05fbc3fc-da8f-4c57-8ce1-7bb3e4815844 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:27.008451 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05fbc3fc-da8f-4c57-8ce1-7bb3e4815844 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:27.009214 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05fbc3fc-da8f-4c57-8ce1-7bb3e4815844 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:27.009652 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05fbc3fc-da8f-4c57-8ce1-7bb3e4815844 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:27.087375 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-05fbc3fc-da8f-4c57-8ce1-7bb3e4815844 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lazy-loading 'services' on Instance uuid 1b4f949c-a6ee-4f9f-8e28-864aaeb99517 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:04:27.158280 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-05fbc3fc-da8f-4c57-8ce1-7bb3e4815844 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517/os-volume_attachments/ea73e53e-1d7e-4ec5-b83f-5e4ae050a401" status: 202 len: 0 microversion: 2.1 time: 0.160944 May 10 20:04:27.160056 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 392/763] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 20:04:26 2022] DELETE /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517/os-volume_attachments/ea73e53e-1d7e-4ec5-b83f-5e4ae050a401 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:04:28.280985 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4bab9511-3ada-4609-8ae7-df8af7dd3b8b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:28.281509 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4bab9511-3ada-4609-8ae7-df8af7dd3b8b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:28.287394 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bab9511-3ada-4609-8ae7-df8af7dd3b8b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:28.287882 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bab9511-3ada-4609-8ae7-df8af7dd3b8b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:28.289271 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bab9511-3ada-4609-8ae7-df8af7dd3b8b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:28.289740 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bab9511-3ada-4609-8ae7-df8af7dd3b8b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:28.318230 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4bab9511-3ada-4609-8ae7-df8af7dd3b8b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:04:28.392790 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4bab9511-3ada-4609-8ae7-df8af7dd3b8b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 204 len: 0 microversion: 2.1 time: 0.115510 May 10 20:04:28.393775 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 372/764] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:04:28 2022] DELETE /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:04:28.403046 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-825ef9c6-841a-43c8-a57c-bb711dcf0c70 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:28.403757 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-825ef9c6-841a-43c8-a57c-bb711dcf0c70 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:28.410400 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-825ef9c6-841a-43c8-a57c-bb711dcf0c70 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:28.410879 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-825ef9c6-841a-43c8-a57c-bb711dcf0c70 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:28.411651 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-825ef9c6-841a-43c8-a57c-bb711dcf0c70 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:28.412085 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-825ef9c6-841a-43c8-a57c-bb711dcf0c70 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:28.560625 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-825ef9c6-841a-43c8-a57c-bb711dcf0c70 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:28.568352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-825ef9c6-841a-43c8-a57c-bb711dcf0c70 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1511 microversion: 2.1 time: 0.169920 May 10 20:04:28.568924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 393/765] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:28 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:29.586444 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-635592f2-51e9-4c9e-b644-9a58e411eff4 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:29.587159 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-635592f2-51e9-4c9e-b644-9a58e411eff4 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:29.593402 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-635592f2-51e9-4c9e-b644-9a58e411eff4 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:29.593850 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-635592f2-51e9-4c9e-b644-9a58e411eff4 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:29.594672 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-635592f2-51e9-4c9e-b644-9a58e411eff4 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:29.595072 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-635592f2-51e9-4c9e-b644-9a58e411eff4 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:29.722646 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-635592f2-51e9-4c9e-b644-9a58e411eff4 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:29.730504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-635592f2-51e9-4c9e-b644-9a58e411eff4 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1511 microversion: 2.1 time: 0.148225 May 10 20:04:29.731079 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 373/766] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:29 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:30.617601 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-d51d9e83-6c75-47d9-83eb-0ef3a107880d req-3db417fc-66a1-4352-9160-e6f389980e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4f949c-a6ee-4f9f-8e28-864aaeb99517", "name": "network-vif-deleted", "tag": "152b6e28-0758-4d79-8ac9-9589400cbbc8"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:30.626308 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-d51d9e83-6c75-47d9-83eb-0ef3a107880d req-3db417fc-66a1-4352-9160-e6f389980e74 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:30.626916 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-d51d9e83-6c75-47d9-83eb-0ef3a107880d req-3db417fc-66a1-4352-9160-e6f389980e74 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:30.637553 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-d51d9e83-6c75-47d9-83eb-0ef3a107880d req-3db417fc-66a1-4352-9160-e6f389980e74 service nova] Creating event network-vif-deleted:152b6e28-0758-4d79-8ac9-9589400cbbc8 for instance 1b4f949c-a6ee-4f9f-8e28-864aaeb99517 on hv-cinder-84131 May 10 20:04:30.642170 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-d51d9e83-6c75-47d9-83eb-0ef3a107880d req-3db417fc-66a1-4352-9160-e6f389980e74 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029589 May 10 20:04:30.642786 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 394/767] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:04:30.747045 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e01eb932-8680-4a98-bd8a-abd58adde123 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:30.747665 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e01eb932-8680-4a98-bd8a-abd58adde123 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:30.754051 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e01eb932-8680-4a98-bd8a-abd58adde123 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:30.754548 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e01eb932-8680-4a98-bd8a-abd58adde123 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:30.755320 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e01eb932-8680-4a98-bd8a-abd58adde123 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:30.755763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e01eb932-8680-4a98-bd8a-abd58adde123 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:30.816393 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e01eb932-8680-4a98-bd8a-abd58adde123 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:30.823781 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e01eb932-8680-4a98-bd8a-abd58adde123 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1469 microversion: 2.1 time: 0.080579 May 10 20:04:30.824343 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 374/768] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:30 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1469 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:31.846296 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-38bbf470-e12f-4728-a13e-605a292daf60 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:31.846957 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-38bbf470-e12f-4728-a13e-605a292daf60 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:31.853186 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38bbf470-e12f-4728-a13e-605a292daf60 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:31.853633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38bbf470-e12f-4728-a13e-605a292daf60 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:31.854390 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38bbf470-e12f-4728-a13e-605a292daf60 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:31.854844 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38bbf470-e12f-4728-a13e-605a292daf60 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:31.915125 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-38bbf470-e12f-4728-a13e-605a292daf60 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:31.922175 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-38bbf470-e12f-4728-a13e-605a292daf60 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1303 microversion: 2.1 time: 0.081558 May 10 20:04:31.922782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 395/769] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:31 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:32.938876 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cf045340-bae1-4dec-baf0-4fdeeb5b49b6 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:32.939475 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cf045340-bae1-4dec-baf0-4fdeeb5b49b6 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:32.945777 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf045340-bae1-4dec-baf0-4fdeeb5b49b6 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:32.946229 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf045340-bae1-4dec-baf0-4fdeeb5b49b6 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:32.947025 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf045340-bae1-4dec-baf0-4fdeeb5b49b6 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:32.947465 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf045340-bae1-4dec-baf0-4fdeeb5b49b6 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:33.011341 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cf045340-bae1-4dec-baf0-4fdeeb5b49b6 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:33.018844 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cf045340-bae1-4dec-baf0-4fdeeb5b49b6 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 200 len: 1303 microversion: 2.1 time: 0.083783 May 10 20:04:33.019411 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 375/770] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:32 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 1303 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:34.036186 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f81445a7-450b-418c-8939-c9636eb06bea tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:34.036800 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f81445a7-450b-418c-8939-c9636eb06bea tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: 1b4f949c-a6ee-4f9f-8e28-864aaeb99517] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:34.043646 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f81445a7-450b-418c-8939-c9636eb06bea tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:34.044100 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f81445a7-450b-418c-8939-c9636eb06bea tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:34.044868 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f81445a7-450b-418c-8939-c9636eb06bea tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:34.045306 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f81445a7-450b-418c-8939-c9636eb06bea tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:34.058916 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-f81445a7-450b-418c-8939-c9636eb06bea tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] HTTP exception thrown: Instance 1b4f949c-a6ee-4f9f-8e28-864aaeb99517 could not be found. May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f81445a7-450b-418c-8939-c9636eb06bea tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Request method failure captured: May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 HTTP/1.1 May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesUQti_jh15mQBCyjAUaBceFznFdMUd2GfNWo1OX5fSKEPBCi7hVaccI1VfDcpvQi1-4YDeuty4SJ83SWkQIrPMseDEbF7HxsDxBn0pSa7n0My3HUwZVvdcpSLj0SWxhgerDH_DdArRgzRuselhT3rRK2j6FnxjNPIxSocsQ4cACVyg May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 143c50428b1247a9ac6f60a26bfbaa80 May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-VolumesSnapshotTestJSON-409482723 May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:04:34.060520 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/143c50428b1247a9ac6f60a26bfbaa80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_143c50428b1247a9ac6f60a26bfbaa80", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/143c50428b1247a9ac6f60a26bfbaa80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/143c50428b1247a9ac6f60a26bfbaa80"}]}] May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-VolumesSnapshotTestJSON-409482723 May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 143c50428b1247a9ac6f60a26bfbaa80 May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-409482723 May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-VolumesSnapshotTestJSON-409482723-project May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 4ed6cd976b1442718a7b307588b57431 May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-VolumesSnapshotTestJSON-409482723-project May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 1b4f949c-a6ee-4f9f-8e28-864aaeb99517 could not be found. May 10 20:04:34.061998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '1b4f949c-a6ee-4f9f-8e28-864aaeb99517'} May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4f949c-a6ee-4f9f-8e28-864aaeb99517 could not be found. May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:04:34.062873 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4f949c-a6ee-4f9f-8e28-864aaeb99517 could not be found. May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4f949c-a6ee-4f9f-8e28-864aaeb99517 could not be found. May 10 20:04:34.064374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:04:34.065785 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f81445a7-450b-418c-8939-c9636eb06bea tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Returning 404 to user: Instance 1b4f949c-a6ee-4f9f-8e28-864aaeb99517 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:04:34.065785 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f81445a7-450b-418c-8939-c9636eb06bea tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517" status: 404 len: 111 microversion: 2.1 time: 0.029572 May 10 20:04:34.065785 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 396/771] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:34 2022] GET /compute/v2.1/servers/1b4f949c-a6ee-4f9f-8e28-864aaeb99517 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:04:43.889662 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-766302481", "imageRef": "75d8bf4f-6953-438e-9ff8-e424f5b0bea4", "flavorRef": "452", "networks": [{"uuid": "6c1a4f20-babc-42e5-978f-c3e4365331a8"}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:43.943768 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] validate_networks() for [('6c1a4f20-babc-42e5-978f-c3e4365331a8', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:04:44.278619 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:04:44.279052 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:04:44.279568 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:04:44.279979 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:04:44.280395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:04:44.289028 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:44.289483 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:44.290292 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:44.290767 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:44.307302 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Getting quotas for project 143c50428b1247a9ac6f60a26bfbaa80. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:04:44.311050 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Getting quotas for user 4ed6cd976b1442718a7b307588b57431 and project 143c50428b1247a9ac6f60a26bfbaa80. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:04:44.321880 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:04:44.324152 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75d8bf4f-6953-438e-9ff8-e424f5b0bea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:04:44.366863 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d8b48e61-37d5-481d-a4a8-2b9a8f37c444 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480965 May 10 20:04:44.367511 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 376/772] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:04:44.377660 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f2fb604b-91ff-467b-8555-8769d36ab146 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:44.378277 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f2fb604b-91ff-467b-8555-8769d36ab146 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:44.430154 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f2fb604b-91ff-467b-8555-8769d36ab146 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:44.436760 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f2fb604b-91ff-467b-8555-8769d36ab146 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1218 microversion: 2.1 time: 0.063060 May 10 20:04:44.437329 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 397/773] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:44 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:45.454179 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f94146da-f00a-4687-8ef6-fd52ba1d578d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:45.454829 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f94146da-f00a-4687-8ef6-fd52ba1d578d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:45.463406 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f94146da-f00a-4687-8ef6-fd52ba1d578d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:45.463868 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f94146da-f00a-4687-8ef6-fd52ba1d578d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:45.464644 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f94146da-f00a-4687-8ef6-fd52ba1d578d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:45.465086 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f94146da-f00a-4687-8ef6-fd52ba1d578d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:45.532052 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f94146da-f00a-4687-8ef6-fd52ba1d578d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:45.540037 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f94146da-f00a-4687-8ef6-fd52ba1d578d tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1276 microversion: 2.1 time: 0.090238 May 10 20:04:45.540614 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 377/774] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:45 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:46.557767 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ac243637-e81d-4a56-a2e5-1c7bb9d454aa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:46.558388 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ac243637-e81d-4a56-a2e5-1c7bb9d454aa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:46.566273 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ac243637-e81d-4a56-a2e5-1c7bb9d454aa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:46.566753 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ac243637-e81d-4a56-a2e5-1c7bb9d454aa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:46.567525 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ac243637-e81d-4a56-a2e5-1c7bb9d454aa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:46.568153 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ac243637-e81d-4a56-a2e5-1c7bb9d454aa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:46.698167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ac243637-e81d-4a56-a2e5-1c7bb9d454aa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:46.705680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ac243637-e81d-4a56-a2e5-1c7bb9d454aa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1318 microversion: 2.1 time: 0.151966 May 10 20:04:46.706262 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 398/775] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:46 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:46.821933 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-b8fd39ca-e473-4c2b-aabf-346dab88156f req-52a3768e-debc-43d0-84bb-796ce4ca6d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9", "tag": "81adfbbd-ef04-455d-888b-beb9ac597a1b"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:46.832450 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-b8fd39ca-e473-4c2b-aabf-346dab88156f req-52a3768e-debc-43d0-84bb-796ce4ca6d2f service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:46.833167 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-b8fd39ca-e473-4c2b-aabf-346dab88156f req-52a3768e-debc-43d0-84bb-796ce4ca6d2f service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:46.845157 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-b8fd39ca-e473-4c2b-aabf-346dab88156f req-52a3768e-debc-43d0-84bb-796ce4ca6d2f service nova] Creating event network-changed:81adfbbd-ef04-455d-888b-beb9ac597a1b for instance f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 on hv-cinder-84131 May 10 20:04:46.851520 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-b8fd39ca-e473-4c2b-aabf-346dab88156f req-52a3768e-debc-43d0-84bb-796ce4ca6d2f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033828 May 10 20:04:46.852071 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 378/776] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:04:47.722442 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1948ec00-ca5f-4979-9e06-9f44c0e9056f tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:47.723081 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1948ec00-ca5f-4979-9e06-9f44c0e9056f tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:47.729772 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1948ec00-ca5f-4979-9e06-9f44c0e9056f tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:47.730228 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1948ec00-ca5f-4979-9e06-9f44c0e9056f tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:47.731041 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1948ec00-ca5f-4979-9e06-9f44c0e9056f tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:47.731483 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1948ec00-ca5f-4979-9e06-9f44c0e9056f tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:47.857929 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1948ec00-ca5f-4979-9e06-9f44c0e9056f tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:47.865364 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1948ec00-ca5f-4979-9e06-9f44c0e9056f tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1318 microversion: 2.1 time: 0.146837 May 10 20:04:47.865926 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 399/777] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:47 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:48.882763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9fee7859-8a9a-4cd9-af00-80f0584012fa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:48.883386 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9fee7859-8a9a-4cd9-af00-80f0584012fa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:48.889914 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9fee7859-8a9a-4cd9-af00-80f0584012fa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:48.890366 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9fee7859-8a9a-4cd9-af00-80f0584012fa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:48.891151 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9fee7859-8a9a-4cd9-af00-80f0584012fa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:48.891590 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9fee7859-8a9a-4cd9-af00-80f0584012fa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:49.023333 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9fee7859-8a9a-4cd9-af00-80f0584012fa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:49.030718 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9fee7859-8a9a-4cd9-af00-80f0584012fa tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1318 microversion: 2.1 time: 0.152174 May 10 20:04:49.031302 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 379/778] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:48 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:50.048123 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9954c6cb-ffb6-4aa1-a1af-0dcae587e749 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:50.048662 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9954c6cb-ffb6-4aa1-a1af-0dcae587e749 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:50.055620 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9954c6cb-ffb6-4aa1-a1af-0dcae587e749 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:50.056078 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9954c6cb-ffb6-4aa1-a1af-0dcae587e749 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:50.056855 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9954c6cb-ffb6-4aa1-a1af-0dcae587e749 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:50.057292 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9954c6cb-ffb6-4aa1-a1af-0dcae587e749 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:50.183201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9954c6cb-ffb6-4aa1-a1af-0dcae587e749 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:50.190340 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9954c6cb-ffb6-4aa1-a1af-0dcae587e749 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1318 microversion: 2.1 time: 0.146166 May 10 20:04:50.190944 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 400/779] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:50 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:51.207628 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-847c3235-9979-41f2-aefe-ff6f3b014f5c tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:51.208246 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-847c3235-9979-41f2-aefe-ff6f3b014f5c tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:51.215107 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-847c3235-9979-41f2-aefe-ff6f3b014f5c tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:51.215555 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-847c3235-9979-41f2-aefe-ff6f3b014f5c tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:51.216311 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-847c3235-9979-41f2-aefe-ff6f3b014f5c tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:51.216743 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-847c3235-9979-41f2-aefe-ff6f3b014f5c tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:51.341645 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-847c3235-9979-41f2-aefe-ff6f3b014f5c tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:51.349198 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-847c3235-9979-41f2-aefe-ff6f3b014f5c tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1318 microversion: 2.1 time: 0.145379 May 10 20:04:51.349863 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 380/780] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:51 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:51.468618 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-8351a94e-bbac-4905-b2b7-f79403f9ac57 req-02c60ea1-3ce9-4f4e-b984-61eb3cba47ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9", "name": "network-vif-plugged", "status": "completed", "tag": "81adfbbd-ef04-455d-888b-beb9ac597a1b"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:51.477923 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-8351a94e-bbac-4905-b2b7-f79403f9ac57 req-02c60ea1-3ce9-4f4e-b984-61eb3cba47ca service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:51.478373 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-8351a94e-bbac-4905-b2b7-f79403f9ac57 req-02c60ea1-3ce9-4f4e-b984-61eb3cba47ca service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:51.489883 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-8351a94e-bbac-4905-b2b7-f79403f9ac57 req-02c60ea1-3ce9-4f4e-b984-61eb3cba47ca service nova] Creating event network-vif-plugged:81adfbbd-ef04-455d-888b-beb9ac597a1b for instance f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 on hv-cinder-84131 May 10 20:04:51.495023 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-8351a94e-bbac-4905-b2b7-f79403f9ac57 req-02c60ea1-3ce9-4f4e-b984-61eb3cba47ca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030012 May 10 20:04:51.495645 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 401/781] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:04:52.366966 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8d18c967-abe3-4a0a-9a08-11d45120fdfb tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:52.367578 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8d18c967-abe3-4a0a-9a08-11d45120fdfb tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:52.373842 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d18c967-abe3-4a0a-9a08-11d45120fdfb tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:52.374292 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d18c967-abe3-4a0a-9a08-11d45120fdfb tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:52.375084 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d18c967-abe3-4a0a-9a08-11d45120fdfb tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:52.375518 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d18c967-abe3-4a0a-9a08-11d45120fdfb tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:52.503810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8d18c967-abe3-4a0a-9a08-11d45120fdfb tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:52.511837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8d18c967-abe3-4a0a-9a08-11d45120fdfb tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1318 microversion: 2.1 time: 0.148955 May 10 20:04:52.512417 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 381/782] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:52 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:53.530374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-94ba613a-3498-4264-b801-80a3ff676143 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:04:53.530374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-94ba613a-3498-4264-b801-80a3ff676143 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:53.537453 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94ba613a-3498-4264-b801-80a3ff676143 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:53.537976 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94ba613a-3498-4264-b801-80a3ff676143 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:53.538814 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94ba613a-3498-4264-b801-80a3ff676143 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:53.539250 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94ba613a-3498-4264-b801-80a3ff676143 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:53.665871 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-94ba613a-3498-4264-b801-80a3ff676143 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:04:53.673368 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-94ba613a-3498-4264-b801-80a3ff676143 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1506 microversion: 2.1 time: 0.147992 May 10 20:04:53.673933 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 402/783] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:04:53 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:04:53.689591 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b0a8d474-567c-4624-896b-960dde44af54 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95548271-f5a3-483c-9f37-0be62482a497", "device": "/dev/sdb"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:04:53.691237 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b0a8d474-567c-4624-896b-960dde44af54 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:04:53.697988 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0a8d474-567c-4624-896b-960dde44af54 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:53.698443 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0a8d474-567c-4624-896b-960dde44af54 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:53.699247 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0a8d474-567c-4624-896b-960dde44af54 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:04:53.699693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0a8d474-567c-4624-896b-960dde44af54 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:04:53.928513 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b0a8d474-567c-4624-896b-960dde44af54 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "POST /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242128 May 10 20:04:53.929209 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 382/784] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 20:04:53 2022] POST /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:05:01.522157 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fdcd70e2-f30d-4a47-9bbc-8c13e8deb90b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:01.523284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fdcd70e2-f30d-4a47-9bbc-8c13e8deb90b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:01.529926 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdcd70e2-f30d-4a47-9bbc-8c13e8deb90b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:01.530385 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdcd70e2-f30d-4a47-9bbc-8c13e8deb90b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:01.531204 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdcd70e2-f30d-4a47-9bbc-8c13e8deb90b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:01.531654 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdcd70e2-f30d-4a47-9bbc-8c13e8deb90b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:01.555410 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fdcd70e2-f30d-4a47-9bbc-8c13e8deb90b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/ips" status: 200 len: 152 microversion: 2.20 time: 0.037834 May 10 20:05:01.555986 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 403/785] 10.222.0.57 () {60 vars in 1288 bytes} [Tue May 10 20:05:01 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:05:05.569048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0e88e29e-fcee-4a4a-9c09-7d45c7d5d5d2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:05:05.569671 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0e88e29e-fcee-4a4a-9c09-7d45c7d5d5d2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:05.575809 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0e88e29e-fcee-4a4a-9c09-7d45c7d5d5d2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:05.576257 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0e88e29e-fcee-4a4a-9c09-7d45c7d5d5d2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:05.577025 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0e88e29e-fcee-4a4a-9c09-7d45c7d5d5d2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:05.577464 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0e88e29e-fcee-4a4a-9c09-7d45c7d5d5d2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:05.600013 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-0e88e29e-fcee-4a4a-9c09-7d45c7d5d5d2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lazy-loading 'flavor' on Instance uuid 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:05:05.863761 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0e88e29e-fcee-4a4a-9c09-7d45c7d5d5d2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "POST /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/action" status: 202 len: 0 microversion: 2.20 time: 0.299542 May 10 20:05:05.864594 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 383/786] 10.222.0.57 () {62 vars in 1318 bytes} [Tue May 10 20:05:05 2022] POST /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:05:05.872675 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a305c5a5-354c-44c0-916d-7d0d16b964d4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:05.873416 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a305c5a5-354c-44c0-916d-7d0d16b964d4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:05.879625 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a305c5a5-354c-44c0-916d-7d0d16b964d4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:05.880080 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a305c5a5-354c-44c0-916d-7d0d16b964d4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:05.881356 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a305c5a5-354c-44c0-916d-7d0d16b964d4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:05.881796 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a305c5a5-354c-44c0-916d-7d0d16b964d4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:06.007804 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a305c5a5-354c-44c0-916d-7d0d16b964d4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:06.015455 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a305c5a5-354c-44c0-916d-7d0d16b964d4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:06.016963 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a305c5a5-354c-44c0-916d-7d0d16b964d4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:06.018115 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a305c5a5-354c-44c0-916d-7d0d16b964d4 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.149467 May 10 20:05:06.018714 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 404/787] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:05 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:05:07.037734 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-15c4a258-8361-43e0-a56c-04c6871c9f94 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:07.038359 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-15c4a258-8361-43e0-a56c-04c6871c9f94 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:07.044652 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-15c4a258-8361-43e0-a56c-04c6871c9f94 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:07.045103 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-15c4a258-8361-43e0-a56c-04c6871c9f94 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:07.045866 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-15c4a258-8361-43e0-a56c-04c6871c9f94 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:07.046302 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-15c4a258-8361-43e0-a56c-04c6871c9f94 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:07.174172 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-15c4a258-8361-43e0-a56c-04c6871c9f94 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:07.181976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-15c4a258-8361-43e0-a56c-04c6871c9f94 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:07.183510 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-15c4a258-8361-43e0-a56c-04c6871c9f94 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:07.184845 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-15c4a258-8361-43e0-a56c-04c6871c9f94 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.152036 May 10 20:05:07.185414 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 384/788] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:07 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:08.202831 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a6f2f588-93b2-4602-baca-2328a52f69fb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:08.203448 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a6f2f588-93b2-4602-baca-2328a52f69fb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:08.209524 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a6f2f588-93b2-4602-baca-2328a52f69fb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:08.209973 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a6f2f588-93b2-4602-baca-2328a52f69fb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:08.211277 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a6f2f588-93b2-4602-baca-2328a52f69fb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:08.211715 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a6f2f588-93b2-4602-baca-2328a52f69fb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:08.338794 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a6f2f588-93b2-4602-baca-2328a52f69fb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:08.346449 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a6f2f588-93b2-4602-baca-2328a52f69fb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:08.347967 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a6f2f588-93b2-4602-baca-2328a52f69fb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:08.349112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a6f2f588-93b2-4602-baca-2328a52f69fb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.150209 May 10 20:05:08.349785 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 405/789] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:08 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:09.368260 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d1ac315e-f9cb-44e1-9c15-3809c69ad378 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:09.368861 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d1ac315e-f9cb-44e1-9c15-3809c69ad378 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:09.375213 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1ac315e-f9cb-44e1-9c15-3809c69ad378 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:09.375658 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1ac315e-f9cb-44e1-9c15-3809c69ad378 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:09.376414 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1ac315e-f9cb-44e1-9c15-3809c69ad378 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:09.376847 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1ac315e-f9cb-44e1-9c15-3809c69ad378 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:09.502232 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d1ac315e-f9cb-44e1-9c15-3809c69ad378 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:09.510546 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d1ac315e-f9cb-44e1-9c15-3809c69ad378 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:09.512012 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d1ac315e-f9cb-44e1-9c15-3809c69ad378 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:09.513174 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d1ac315e-f9cb-44e1-9c15-3809c69ad378 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.148796 May 10 20:05:09.513729 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 385/790] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:09 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:10.531902 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2e478ebf-99d4-4737-b6fa-7ab8cdfe9c75 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:10.532537 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2e478ebf-99d4-4737-b6fa-7ab8cdfe9c75 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:10.538911 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e478ebf-99d4-4737-b6fa-7ab8cdfe9c75 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:10.539361 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e478ebf-99d4-4737-b6fa-7ab8cdfe9c75 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:10.540121 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e478ebf-99d4-4737-b6fa-7ab8cdfe9c75 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:10.540556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e478ebf-99d4-4737-b6fa-7ab8cdfe9c75 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:10.671003 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e478ebf-99d4-4737-b6fa-7ab8cdfe9c75 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:10.678764 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e478ebf-99d4-4737-b6fa-7ab8cdfe9c75 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:10.680775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e478ebf-99d4-4737-b6fa-7ab8cdfe9c75 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:10.681924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2e478ebf-99d4-4737-b6fa-7ab8cdfe9c75 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.153887 May 10 20:05:10.682506 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 406/791] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:10 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:11.700252 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c0a7ac33-21dc-44c9-b6fd-5f28e91b409a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:11.700866 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c0a7ac33-21dc-44c9-b6fd-5f28e91b409a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:11.707160 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c0a7ac33-21dc-44c9-b6fd-5f28e91b409a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:11.707611 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c0a7ac33-21dc-44c9-b6fd-5f28e91b409a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:11.708373 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c0a7ac33-21dc-44c9-b6fd-5f28e91b409a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:11.708810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c0a7ac33-21dc-44c9-b6fd-5f28e91b409a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:11.832545 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c0a7ac33-21dc-44c9-b6fd-5f28e91b409a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:11.840730 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c0a7ac33-21dc-44c9-b6fd-5f28e91b409a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:11.842357 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c0a7ac33-21dc-44c9-b6fd-5f28e91b409a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:11.843534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c0a7ac33-21dc-44c9-b6fd-5f28e91b409a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.147191 May 10 20:05:11.844088 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 386/792] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:11 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:05:12.861184 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d1bcbc70-708c-4c41-b812-15b6f51a980c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:12.861750 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d1bcbc70-708c-4c41-b812-15b6f51a980c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:12.868297 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1bcbc70-708c-4c41-b812-15b6f51a980c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:12.868742 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1bcbc70-708c-4c41-b812-15b6f51a980c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:12.869496 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1bcbc70-708c-4c41-b812-15b6f51a980c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:12.869925 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1bcbc70-708c-4c41-b812-15b6f51a980c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:12.992432 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d1bcbc70-708c-4c41-b812-15b6f51a980c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:12.999954 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d1bcbc70-708c-4c41-b812-15b6f51a980c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:13.001449 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d1bcbc70-708c-4c41-b812-15b6f51a980c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:13.002766 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d1bcbc70-708c-4c41-b812-15b6f51a980c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.145373 May 10 20:05:13.003324 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 407/793] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:12 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:13.174049 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-65f135b9-fc70-4ccd-963e-a100c24f8a5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:13.174639 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-65f135b9-fc70-4ccd-963e-a100c24f8a5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:13.180969 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-65f135b9-fc70-4ccd-963e-a100c24f8a5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:13.181426 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-65f135b9-fc70-4ccd-963e-a100c24f8a5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:13.182192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-65f135b9-fc70-4ccd-963e-a100c24f8a5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:13.182674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-65f135b9-fc70-4ccd-963e-a100c24f8a5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:13.263102 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-65f135b9-fc70-4ccd-963e-a100c24f8a5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lazy-loading 'services' on Instance uuid f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:05:13.330518 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-65f135b9-fc70-4ccd-963e-a100c24f8a5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9/os-volume_attachments/95548271-f5a3-483c-9f37-0be62482a497" status: 202 len: 0 microversion: 2.1 time: 0.160216 May 10 20:05:13.331115 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 387/794] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 20:05:13 2022] DELETE /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9/os-volume_attachments/95548271-f5a3-483c-9f37-0be62482a497 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:05:14.021095 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4a1aab5a-085a-4c01-a4e8-a5e1387e2945 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:14.021710 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4a1aab5a-085a-4c01-a4e8-a5e1387e2945 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:14.027997 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a1aab5a-085a-4c01-a4e8-a5e1387e2945 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:14.028449 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a1aab5a-085a-4c01-a4e8-a5e1387e2945 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:14.029223 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a1aab5a-085a-4c01-a4e8-a5e1387e2945 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:14.029664 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a1aab5a-085a-4c01-a4e8-a5e1387e2945 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:14.169341 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4a1aab5a-085a-4c01-a4e8-a5e1387e2945 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:14.177062 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4a1aab5a-085a-4c01-a4e8-a5e1387e2945 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:14.178595 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4a1aab5a-085a-4c01-a4e8-a5e1387e2945 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:14.180290 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4a1aab5a-085a-4c01-a4e8-a5e1387e2945 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.163064 May 10 20:05:14.180858 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 408/795] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:14 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:14.441695 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3fa51c12-f4fa-4389-a128-60f8ef292b5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:14.442278 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3fa51c12-f4fa-4389-a128-60f8ef292b5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:14.449018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fa51c12-f4fa-4389-a128-60f8ef292b5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:14.449467 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fa51c12-f4fa-4389-a128-60f8ef292b5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:14.450224 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fa51c12-f4fa-4389-a128-60f8ef292b5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:14.450693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fa51c12-f4fa-4389-a128-60f8ef292b5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:14.476785 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3fa51c12-f4fa-4389-a128-60f8ef292b5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:05:14.548011 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3fa51c12-f4fa-4389-a128-60f8ef292b5b tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 204 len: 0 microversion: 2.1 time: 0.110662 May 10 20:05:14.548613 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 388/796] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:05:14 2022] DELETE /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:05:14.557998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a3c26cd1-5e8b-49e7-bb69-e1b890a52840 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:14.558646 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a3c26cd1-5e8b-49e7-bb69-e1b890a52840 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:14.564780 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a3c26cd1-5e8b-49e7-bb69-e1b890a52840 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:14.565233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a3c26cd1-5e8b-49e7-bb69-e1b890a52840 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:14.566001 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a3c26cd1-5e8b-49e7-bb69-e1b890a52840 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:14.566486 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a3c26cd1-5e8b-49e7-bb69-e1b890a52840 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:14.690149 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a3c26cd1-5e8b-49e7-bb69-e1b890a52840 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:14.697370 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a3c26cd1-5e8b-49e7-bb69-e1b890a52840 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1512 microversion: 2.1 time: 0.144125 May 10 20:05:14.697963 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 409/797] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:05:14 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1512 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:05:15.198987 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-45b03992-8398-4182-b038-c84e134d3b95 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:15.199712 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-45b03992-8398-4182-b038-c84e134d3b95 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:15.205679 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-45b03992-8398-4182-b038-c84e134d3b95 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:15.206117 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-45b03992-8398-4182-b038-c84e134d3b95 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:15.206908 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-45b03992-8398-4182-b038-c84e134d3b95 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:15.207337 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-45b03992-8398-4182-b038-c84e134d3b95 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:15.337078 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-45b03992-8398-4182-b038-c84e134d3b95 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:15.344713 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-45b03992-8398-4182-b038-c84e134d3b95 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:15.346200 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-45b03992-8398-4182-b038-c84e134d3b95 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:15.347361 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-45b03992-8398-4182-b038-c84e134d3b95 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.152644 May 10 20:05:15.348010 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 389/798] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:15 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:15.714380 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5167945a-7d7a-4118-936f-5107e5aad415 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:15.715021 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5167945a-7d7a-4118-936f-5107e5aad415 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:15.721399 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5167945a-7d7a-4118-936f-5107e5aad415 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:15.721846 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5167945a-7d7a-4118-936f-5107e5aad415 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:15.722720 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5167945a-7d7a-4118-936f-5107e5aad415 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:15.723156 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5167945a-7d7a-4118-936f-5107e5aad415 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:15.850297 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5167945a-7d7a-4118-936f-5107e5aad415 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:15.857797 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5167945a-7d7a-4118-936f-5107e5aad415 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1512 microversion: 2.1 time: 0.147234 May 10 20:05:15.858378 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 410/799] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:05:15 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:05:16.365338 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-bac817d5-2d39-44a4-97d5-83469320907d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:16.365983 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-bac817d5-2d39-44a4-97d5-83469320907d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:16.372317 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bac817d5-2d39-44a4-97d5-83469320907d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:16.372768 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bac817d5-2d39-44a4-97d5-83469320907d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:16.373533 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bac817d5-2d39-44a4-97d5-83469320907d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:16.373966 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bac817d5-2d39-44a4-97d5-83469320907d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:16.515633 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-bac817d5-2d39-44a4-97d5-83469320907d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:16.523581 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-bac817d5-2d39-44a4-97d5-83469320907d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:16.525090 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-bac817d5-2d39-44a4-97d5-83469320907d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:16.526248 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-bac817d5-2d39-44a4-97d5-83469320907d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.165043 May 10 20:05:16.526827 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 390/800] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:16 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:16.874920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-db856970-c360-44b3-9748-793e8f66e0c7 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:16.875531 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-db856970-c360-44b3-9748-793e8f66e0c7 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:16.881994 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db856970-c360-44b3-9748-793e8f66e0c7 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:16.882476 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db856970-c360-44b3-9748-793e8f66e0c7 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:16.883292 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db856970-c360-44b3-9748-793e8f66e0c7 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:16.883728 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db856970-c360-44b3-9748-793e8f66e0c7 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:17.009487 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-db856970-c360-44b3-9748-793e8f66e0c7 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed6cd976b1442718a7b307588b57431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143c50428b1247a9ac6f60a26bfbaa80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:17.016666 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-db856970-c360-44b3-9748-793e8f66e0c7 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 200 len: 1512 microversion: 2.1 time: 0.145594 May 10 20:05:17.017241 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 411/801] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:05:16 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:05:17.281786 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-2851c784-fbb8-4cfd-ad5c-0e4c282171a7 req-e9975b0d-590d-4f1a-b6a2-0e28601cc87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9", "name": "network-vif-deleted", "tag": "81adfbbd-ef04-455d-888b-beb9ac597a1b"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:05:17.291272 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-2851c784-fbb8-4cfd-ad5c-0e4c282171a7 req-e9975b0d-590d-4f1a-b6a2-0e28601cc87d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:17.291946 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-2851c784-fbb8-4cfd-ad5c-0e4c282171a7 req-e9975b0d-590d-4f1a-b6a2-0e28601cc87d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:17.304073 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-2851c784-fbb8-4cfd-ad5c-0e4c282171a7 req-e9975b0d-590d-4f1a-b6a2-0e28601cc87d service nova] Creating event network-vif-deleted:81adfbbd-ef04-455d-888b-beb9ac597a1b for instance f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 on hv-cinder-84131 May 10 20:05:17.309502 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-2851c784-fbb8-4cfd-ad5c-0e4c282171a7 req-e9975b0d-590d-4f1a-b6a2-0e28601cc87d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032403 May 10 20:05:17.310311 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 391/802] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:05:17.544395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e4986964-1009-479b-a328-0d0d28463fbe tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:17.545008 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e4986964-1009-479b-a328-0d0d28463fbe tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:17.551017 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e4986964-1009-479b-a328-0d0d28463fbe tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:17.551470 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e4986964-1009-479b-a328-0d0d28463fbe tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:17.552239 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e4986964-1009-479b-a328-0d0d28463fbe tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:17.552678 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e4986964-1009-479b-a328-0d0d28463fbe tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:17.687407 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e4986964-1009-479b-a328-0d0d28463fbe tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:17.695992 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e4986964-1009-479b-a328-0d0d28463fbe tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:17.697515 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e4986964-1009-479b-a328-0d0d28463fbe tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:17.698709 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e4986964-1009-479b-a328-0d0d28463fbe tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.158219 May 10 20:05:17.699472 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 412/803] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:17 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:18.033696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dd597ad2-7243-4618-8e0f-6046c4bbc7b2 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:18.034403 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dd597ad2-7243-4618-8e0f-6046c4bbc7b2 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] [instance: f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:18.041000 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd597ad2-7243-4618-8e0f-6046c4bbc7b2 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:18.041454 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd597ad2-7243-4618-8e0f-6046c4bbc7b2 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:18.042218 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd597ad2-7243-4618-8e0f-6046c4bbc7b2 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:18.042697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd597ad2-7243-4618-8e0f-6046c4bbc7b2 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:18.055945 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-dd597ad2-7243-4618-8e0f-6046c4bbc7b2 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] HTTP exception thrown: Instance f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 could not be found. May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dd597ad2-7243-4618-8e0f-6046c4bbc7b2 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Request method failure captured: May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 HTTP/1.1 May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesUQti_jh15mQBCyjAUaBceFznFdMUd2GfNWo1OX5fSKEPBCi7hVaccI1VfDcpvQi1-4YDeuty4SJ83SWkQIrPMseDEbF7HxsDxBn0pSa7n0My3HUwZVvdcpSLj0SWxhgerDH_DdArRgzRuselhT3rRK2j6FnxjNPIxSocsQ4cACVyg May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 143c50428b1247a9ac6f60a26bfbaa80 May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-VolumesSnapshotTestJSON-409482723 May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:05:18.057531 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/143c50428b1247a9ac6f60a26bfbaa80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_143c50428b1247a9ac6f60a26bfbaa80", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/143c50428b1247a9ac6f60a26bfbaa80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/143c50428b1247a9ac6f60a26bfbaa80"}]}] May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-VolumesSnapshotTestJSON-409482723 May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 143c50428b1247a9ac6f60a26bfbaa80 May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-409482723 May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-VolumesSnapshotTestJSON-409482723-project May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 4ed6cd976b1442718a7b307588b57431 May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-VolumesSnapshotTestJSON-409482723-project May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 could not be found. May 10 20:05:18.059223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': 'f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9'} May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 could not be found. May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:05:18.060163 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 could not be found. May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 could not be found. May 10 20:05:18.061755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:05:18.063153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dd597ad2-7243-4618-8e0f-6046c4bbc7b2 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] Returning 404 to user: Instance f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:05:18.063153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dd597ad2-7243-4618-8e0f-6046c4bbc7b2 tempest-VolumesSnapshotTestJSON-409482723 tempest-VolumesSnapshotTestJSON-409482723-project] 10.222.0.57 "GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9" status: 404 len: 111 microversion: 2.1 time: 0.029655 May 10 20:05:18.063153 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 392/804] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:05:18 2022] GET /compute/v2.1/servers/f1403562-6a3e-4fb8-9b49-e9b2b8c70fd9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:05:18.717318 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e72d4377-02af-43dd-943d-011ac193b4ca tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:18.717916 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e72d4377-02af-43dd-943d-011ac193b4ca tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:18.724151 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e72d4377-02af-43dd-943d-011ac193b4ca tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:18.724605 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e72d4377-02af-43dd-943d-011ac193b4ca tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:18.725366 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e72d4377-02af-43dd-943d-011ac193b4ca tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:18.725867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e72d4377-02af-43dd-943d-011ac193b4ca tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:18.852239 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e72d4377-02af-43dd-943d-011ac193b4ca tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:18.859942 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e72d4377-02af-43dd-943d-011ac193b4ca tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:18.861431 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e72d4377-02af-43dd-943d-011ac193b4ca tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:18.862885 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e72d4377-02af-43dd-943d-011ac193b4ca tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.149252 May 10 20:05:18.863432 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 413/805] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:18 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:19.881248 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0ed6efdd-73cd-4683-98c0-cd93b9c0b6e3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:19.881769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0ed6efdd-73cd-4683-98c0-cd93b9c0b6e3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:19.888151 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0ed6efdd-73cd-4683-98c0-cd93b9c0b6e3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:19.888604 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0ed6efdd-73cd-4683-98c0-cd93b9c0b6e3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:19.889375 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0ed6efdd-73cd-4683-98c0-cd93b9c0b6e3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:19.889816 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0ed6efdd-73cd-4683-98c0-cd93b9c0b6e3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:20.021672 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0ed6efdd-73cd-4683-98c0-cd93b9c0b6e3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:20.029368 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0ed6efdd-73cd-4683-98c0-cd93b9c0b6e3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:20.030922 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0ed6efdd-73cd-4683-98c0-cd93b9c0b6e3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:20.032077 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0ed6efdd-73cd-4683-98c0-cd93b9c0b6e3 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.154916 May 10 20:05:20.032644 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 393/806] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:19 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:21.050755 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-74a331bc-384d-4ea1-af9d-0f5c0fbf5649 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:21.051398 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-74a331bc-384d-4ea1-af9d-0f5c0fbf5649 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:21.058445 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-74a331bc-384d-4ea1-af9d-0f5c0fbf5649 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:21.058928 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-74a331bc-384d-4ea1-af9d-0f5c0fbf5649 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:21.059702 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-74a331bc-384d-4ea1-af9d-0f5c0fbf5649 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:21.060179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-74a331bc-384d-4ea1-af9d-0f5c0fbf5649 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:21.186324 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-74a331bc-384d-4ea1-af9d-0f5c0fbf5649 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:21.194233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-74a331bc-384d-4ea1-af9d-0f5c0fbf5649 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:21.196463 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-74a331bc-384d-4ea1-af9d-0f5c0fbf5649 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:21.197623 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-74a331bc-384d-4ea1-af9d-0f5c0fbf5649 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.150781 May 10 20:05:21.198193 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 414/807] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:21 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:22.216403 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d35d682f-2e97-47c5-b3fe-c5eacb8ba4c0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:22.217003 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d35d682f-2e97-47c5-b3fe-c5eacb8ba4c0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:22.223354 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d35d682f-2e97-47c5-b3fe-c5eacb8ba4c0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:22.223805 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d35d682f-2e97-47c5-b3fe-c5eacb8ba4c0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:22.224565 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d35d682f-2e97-47c5-b3fe-c5eacb8ba4c0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:22.225008 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d35d682f-2e97-47c5-b3fe-c5eacb8ba4c0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:22.348351 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d35d682f-2e97-47c5-b3fe-c5eacb8ba4c0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:22.356083 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d35d682f-2e97-47c5-b3fe-c5eacb8ba4c0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:22.357596 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d35d682f-2e97-47c5-b3fe-c5eacb8ba4c0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:22.358819 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d35d682f-2e97-47c5-b3fe-c5eacb8ba4c0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.146354 May 10 20:05:22.359378 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 394/808] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:22 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:23.377176 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f2e1c183-94a3-4d27-8c05-beecdcc8ba05 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:23.377789 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f2e1c183-94a3-4d27-8c05-beecdcc8ba05 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:23.384151 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f2e1c183-94a3-4d27-8c05-beecdcc8ba05 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:23.384602 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f2e1c183-94a3-4d27-8c05-beecdcc8ba05 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:23.385363 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f2e1c183-94a3-4d27-8c05-beecdcc8ba05 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:23.385800 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f2e1c183-94a3-4d27-8c05-beecdcc8ba05 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:23.512390 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f2e1c183-94a3-4d27-8c05-beecdcc8ba05 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:23.520053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f2e1c183-94a3-4d27-8c05-beecdcc8ba05 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:23.521568 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f2e1c183-94a3-4d27-8c05-beecdcc8ba05 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:23.522759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f2e1c183-94a3-4d27-8c05-beecdcc8ba05 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1744 microversion: 2.20 time: 0.149462 May 10 20:05:23.524073 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 415/809] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:23 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:24.542115 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-201b6a54-70a1-4272-8b0f-0465b3ddbd87 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:24.542755 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-201b6a54-70a1-4272-8b0f-0465b3ddbd87 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:24.548665 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-201b6a54-70a1-4272-8b0f-0465b3ddbd87 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:24.549109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-201b6a54-70a1-4272-8b0f-0465b3ddbd87 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:24.549864 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-201b6a54-70a1-4272-8b0f-0465b3ddbd87 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:24.550483 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-201b6a54-70a1-4272-8b0f-0465b3ddbd87 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:24.681780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-201b6a54-70a1-4272-8b0f-0465b3ddbd87 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:24.689409 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-201b6a54-70a1-4272-8b0f-0465b3ddbd87 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:24.690941 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-201b6a54-70a1-4272-8b0f-0465b3ddbd87 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:24.692090 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-201b6a54-70a1-4272-8b0f-0465b3ddbd87 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1744 microversion: 2.20 time: 0.154490 May 10 20:05:24.692653 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 395/810] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:24 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:25.709254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-11cf0162-f312-442e-b980-47931e60a4a2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:25.710014 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-11cf0162-f312-442e-b980-47931e60a4a2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:25.716812 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11cf0162-f312-442e-b980-47931e60a4a2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:25.717269 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11cf0162-f312-442e-b980-47931e60a4a2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:25.718053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11cf0162-f312-442e-b980-47931e60a4a2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:25.718561 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11cf0162-f312-442e-b980-47931e60a4a2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:25.875446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-11cf0162-f312-442e-b980-47931e60a4a2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:25.884795 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-11cf0162-f312-442e-b980-47931e60a4a2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:25.887192 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-11cf0162-f312-442e-b980-47931e60a4a2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:25.888655 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-11cf0162-f312-442e-b980-47931e60a4a2 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1739 microversion: 2.20 time: 0.183283 May 10 20:05:25.889481 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 416/811] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:25 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:26.909862 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-55dafc95-20a6-4545-9a22-789e3807d389 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:26.910712 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-55dafc95-20a6-4545-9a22-789e3807d389 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:26.916896 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-55dafc95-20a6-4545-9a22-789e3807d389 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:26.918910 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-55dafc95-20a6-4545-9a22-789e3807d389 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:26.919721 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-55dafc95-20a6-4545-9a22-789e3807d389 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:26.920181 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-55dafc95-20a6-4545-9a22-789e3807d389 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:27.068237 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-55dafc95-20a6-4545-9a22-789e3807d389 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:27.077108 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-55dafc95-20a6-4545-9a22-789e3807d389 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:27.079184 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-55dafc95-20a6-4545-9a22-789e3807d389 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:27.080424 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-55dafc95-20a6-4545-9a22-789e3807d389 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1739 microversion: 2.20 time: 0.174434 May 10 20:05:27.080986 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 396/812] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:26 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:05:27.736597 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-53b9e004-2167-492b-a1bb-95e817d64077 req-7ed49ae6-2fa9-48a7-8eea-069405dfe521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5", "name": "network-vif-plugged", "status": "completed", "tag": "ce79326e-c370-40ae-ba6d-04bd30bc39a2"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:05:27.746951 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-53b9e004-2167-492b-a1bb-95e817d64077 req-7ed49ae6-2fa9-48a7-8eea-069405dfe521 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:27.747862 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-53b9e004-2167-492b-a1bb-95e817d64077 req-7ed49ae6-2fa9-48a7-8eea-069405dfe521 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:27.762796 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-53b9e004-2167-492b-a1bb-95e817d64077 req-7ed49ae6-2fa9-48a7-8eea-069405dfe521 service nova] Creating event network-vif-plugged:ce79326e-c370-40ae-ba6d-04bd30bc39a2 for instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 on hv-cinder-84131 May 10 20:05:27.769352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-53b9e004-2167-492b-a1bb-95e817d64077 req-7ed49ae6-2fa9-48a7-8eea-069405dfe521 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036231 May 10 20:05:27.772142 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 417/813] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:05:28.099293 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1aa7746a-4ace-4dd4-8d31-64a2e499108c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:28.099994 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1aa7746a-4ace-4dd4-8d31-64a2e499108c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:28.108895 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1aa7746a-4ace-4dd4-8d31-64a2e499108c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:28.109441 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1aa7746a-4ace-4dd4-8d31-64a2e499108c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:28.110302 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1aa7746a-4ace-4dd4-8d31-64a2e499108c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:28.110857 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1aa7746a-4ace-4dd4-8d31-64a2e499108c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:28.257532 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1aa7746a-4ace-4dd4-8d31-64a2e499108c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:28.266733 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1aa7746a-4ace-4dd4-8d31-64a2e499108c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:28.268383 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1aa7746a-4ace-4dd4-8d31-64a2e499108c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:28.269646 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1aa7746a-4ace-4dd4-8d31-64a2e499108c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1739 microversion: 2.20 time: 0.174352 May 10 20:05:28.270550 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 397/814] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:28 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:29.291203 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e1ea4ebc-fe44-4ec7-b85f-0495c69ae37f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:29.292044 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e1ea4ebc-fe44-4ec7-b85f-0495c69ae37f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:29.301933 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1ea4ebc-fe44-4ec7-b85f-0495c69ae37f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:29.302560 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1ea4ebc-fe44-4ec7-b85f-0495c69ae37f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:29.303593 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1ea4ebc-fe44-4ec7-b85f-0495c69ae37f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:29.304402 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1ea4ebc-fe44-4ec7-b85f-0495c69ae37f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:29.456282 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e1ea4ebc-fe44-4ec7-b85f-0495c69ae37f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:29.466264 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e1ea4ebc-fe44-4ec7-b85f-0495c69ae37f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:29.468216 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e1ea4ebc-fe44-4ec7-b85f-0495c69ae37f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:29.470810 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e1ea4ebc-fe44-4ec7-b85f-0495c69ae37f tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1739 microversion: 2.20 time: 0.184939 May 10 20:05:29.472702 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 418/815] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:29 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:30.489304 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-336820de-2275-400a-a55e-b9909e4bc3a7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:30.490589 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-336820de-2275-400a-a55e-b9909e4bc3a7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:30.497509 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-336820de-2275-400a-a55e-b9909e4bc3a7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:30.497965 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-336820de-2275-400a-a55e-b9909e4bc3a7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:30.499067 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-336820de-2275-400a-a55e-b9909e4bc3a7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:30.499777 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-336820de-2275-400a-a55e-b9909e4bc3a7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:30.637632 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-336820de-2275-400a-a55e-b9909e4bc3a7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:30.646413 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-336820de-2275-400a-a55e-b9909e4bc3a7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:30.648018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-336820de-2275-400a-a55e-b9909e4bc3a7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:30.649406 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-336820de-2275-400a-a55e-b9909e4bc3a7 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1739 microversion: 2.20 time: 0.164236 May 10 20:05:30.651241 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 398/816] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:30 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:31.671392 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c1533410-91a5-42c6-84b0-2a64f0de2f3b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:31.673584 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c1533410-91a5-42c6-84b0-2a64f0de2f3b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:31.680504 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1533410-91a5-42c6-84b0-2a64f0de2f3b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:31.681866 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1533410-91a5-42c6-84b0-2a64f0de2f3b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:31.682910 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1533410-91a5-42c6-84b0-2a64f0de2f3b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:31.683353 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1533410-91a5-42c6-84b0-2a64f0de2f3b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:31.842894 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c1533410-91a5-42c6-84b0-2a64f0de2f3b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:31.854085 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c1533410-91a5-42c6-84b0-2a64f0de2f3b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:31.855633 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c1533410-91a5-42c6-84b0-2a64f0de2f3b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:31.856806 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c1533410-91a5-42c6-84b0-2a64f0de2f3b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1739 microversion: 2.20 time: 0.192298 May 10 20:05:31.857376 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 419/817] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:31 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:32.875971 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5ebf4d59-6301-4bbd-b65c-e4fac196ccc0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:32.876733 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5ebf4d59-6301-4bbd-b65c-e4fac196ccc0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:32.888228 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ebf4d59-6301-4bbd-b65c-e4fac196ccc0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:32.888781 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ebf4d59-6301-4bbd-b65c-e4fac196ccc0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:32.889637 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ebf4d59-6301-4bbd-b65c-e4fac196ccc0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:32.890147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ebf4d59-6301-4bbd-b65c-e4fac196ccc0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:33.034267 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5ebf4d59-6301-4bbd-b65c-e4fac196ccc0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:33.043496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5ebf4d59-6301-4bbd-b65c-e4fac196ccc0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:33.045348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5ebf4d59-6301-4bbd-b65c-e4fac196ccc0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:33.046578 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5ebf4d59-6301-4bbd-b65c-e4fac196ccc0 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1739 microversion: 2.20 time: 0.174752 May 10 20:05:33.047148 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 399/818] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:32 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:34.065188 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-46596ff4-43b7-4994-90da-0ff0b2eeaece tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:34.065757 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-46596ff4-43b7-4994-90da-0ff0b2eeaece tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:34.073307 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-46596ff4-43b7-4994-90da-0ff0b2eeaece tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:34.073765 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-46596ff4-43b7-4994-90da-0ff0b2eeaece tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:34.074605 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-46596ff4-43b7-4994-90da-0ff0b2eeaece tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:34.075047 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-46596ff4-43b7-4994-90da-0ff0b2eeaece tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:34.215650 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-46596ff4-43b7-4994-90da-0ff0b2eeaece tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:34.223653 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-46596ff4-43b7-4994-90da-0ff0b2eeaece tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:34.225300 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-46596ff4-43b7-4994-90da-0ff0b2eeaece tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:34.226452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-46596ff4-43b7-4994-90da-0ff0b2eeaece tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1739 microversion: 2.20 time: 0.165310 May 10 20:05:34.227024 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 420/819] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:34 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:35.245195 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6bab9a3e-e178-47c3-99e8-d90c8951e4cb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:35.246193 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6bab9a3e-e178-47c3-99e8-d90c8951e4cb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:35.252312 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6bab9a3e-e178-47c3-99e8-d90c8951e4cb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:35.252770 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6bab9a3e-e178-47c3-99e8-d90c8951e4cb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:35.253552 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6bab9a3e-e178-47c3-99e8-d90c8951e4cb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:35.253989 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6bab9a3e-e178-47c3-99e8-d90c8951e4cb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:35.445845 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6bab9a3e-e178-47c3-99e8-d90c8951e4cb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:35.454168 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6bab9a3e-e178-47c3-99e8-d90c8951e4cb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:35.455707 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6bab9a3e-e178-47c3-99e8-d90c8951e4cb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:35.456858 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6bab9a3e-e178-47c3-99e8-d90c8951e4cb tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1721 microversion: 2.20 time: 0.215727 May 10 20:05:35.457425 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 400/820] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:35 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:36.475922 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ee34ec15-c17d-4f98-a9d4-aee53418c222 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:36.477008 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ee34ec15-c17d-4f98-a9d4-aee53418c222 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:36.483525 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ee34ec15-c17d-4f98-a9d4-aee53418c222 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:36.483975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ee34ec15-c17d-4f98-a9d4-aee53418c222 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:36.484730 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ee34ec15-c17d-4f98-a9d4-aee53418c222 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:36.485162 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ee34ec15-c17d-4f98-a9d4-aee53418c222 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:36.613677 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ee34ec15-c17d-4f98-a9d4-aee53418c222 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:36.621238 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ee34ec15-c17d-4f98-a9d4-aee53418c222 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:36.622764 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ee34ec15-c17d-4f98-a9d4-aee53418c222 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:36.623900 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ee34ec15-c17d-4f98-a9d4-aee53418c222 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1721 microversion: 2.20 time: 0.151910 May 10 20:05:36.624457 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 421/821] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:36 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:37.641772 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dc4d4b22-4795-4c56-8404-0578438e961b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:37.642434 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dc4d4b22-4795-4c56-8404-0578438e961b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:37.648677 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc4d4b22-4795-4c56-8404-0578438e961b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:37.649124 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc4d4b22-4795-4c56-8404-0578438e961b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:37.649890 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc4d4b22-4795-4c56-8404-0578438e961b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:37.650320 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc4d4b22-4795-4c56-8404-0578438e961b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:37.679550 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-340819b9-b724-42e3-ae09-770a99006492 req-90531de4-a0c8-4189-b9a7-a6289de16d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5", "name": "network-vif-unplugged", "status": "completed", "tag": "ce79326e-c370-40ae-ba6d-04bd30bc39a2"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:05:37.689665 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-340819b9-b724-42e3-ae09-770a99006492 req-90531de4-a0c8-4189-b9a7-a6289de16d41 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:37.690346 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-340819b9-b724-42e3-ae09-770a99006492 req-90531de4-a0c8-4189-b9a7-a6289de16d41 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:37.702806 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-340819b9-b724-42e3-ae09-770a99006492 req-90531de4-a0c8-4189-b9a7-a6289de16d41 service nova] Creating event network-vif-unplugged:ce79326e-c370-40ae-ba6d-04bd30bc39a2 for instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 on hv-cinder-84131 May 10 20:05:37.708512 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-340819b9-b724-42e3-ae09-770a99006492 req-90531de4-a0c8-4189-b9a7-a6289de16d41 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033069 May 10 20:05:37.709721 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 422/822] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:05:37.801237 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dc4d4b22-4795-4c56-8404-0578438e961b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:37.809500 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dc4d4b22-4795-4c56-8404-0578438e961b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:37.811048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dc4d4b22-4795-4c56-8404-0578438e961b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:37.812207 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dc4d4b22-4795-4c56-8404-0578438e961b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1724 microversion: 2.20 time: 0.174385 May 10 20:05:37.812768 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 401/823] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:37 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:37.830200 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0f89cde3-1c89-488f-b879-3a38ac6de866 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d8f30d5-6b08-4296-aa5b-6cbaf311b41b"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:05:37.831387 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0f89cde3-1c89-488f-b879-3a38ac6de866 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:37.837511 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0f89cde3-1c89-488f-b879-3a38ac6de866 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:37.837969 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0f89cde3-1c89-488f-b879-3a38ac6de866 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:37.838772 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0f89cde3-1c89-488f-b879-3a38ac6de866 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:37.839261 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0f89cde3-1c89-488f-b879-3a38ac6de866 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:38.131171 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0f89cde3-1c89-488f-b879-3a38ac6de866 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "POST /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305204 May 10 20:05:38.132042 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 423/824] 10.222.0.57 () {62 vars in 1363 bytes} [Tue May 10 20:05:37 2022] POST /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:05:38.252168 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-72aaa8a9-e3c9-4857-8aeb-35481d8cdbc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:38.252659 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-72aaa8a9-e3c9-4857-8aeb-35481d8cdbc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:38.258429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72aaa8a9-e3c9-4857-8aeb-35481d8cdbc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:38.258935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72aaa8a9-e3c9-4857-8aeb-35481d8cdbc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:38.259696 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72aaa8a9-e3c9-4857-8aeb-35481d8cdbc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:38.260128 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72aaa8a9-e3c9-4857-8aeb-35481d8cdbc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:38.498317 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-72aaa8a9-e3c9-4857-8aeb-35481d8cdbc1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "DELETE /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/os-volume_attachments/3d8f30d5-6b08-4296-aa5b-6cbaf311b41b" status: 202 len: 0 microversion: 2.20 time: 0.249914 May 10 20:05:38.498965 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 402/825] 10.222.0.57 () {60 vars in 1456 bytes} [Tue May 10 20:05:38 2022] DELETE /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/os-volume_attachments/3d8f30d5-6b08-4296-aa5b-6cbaf311b41b => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:05:38.553303 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ea473757-5aae-4b9a-9322-8659933a4c22 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:05:38.553906 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ea473757-5aae-4b9a-9322-8659933a4c22 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:38.560575 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ea473757-5aae-4b9a-9322-8659933a4c22 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:38.561033 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ea473757-5aae-4b9a-9322-8659933a4c22 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:38.561805 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ea473757-5aae-4b9a-9322-8659933a4c22 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:38.562245 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ea473757-5aae-4b9a-9322-8659933a4c22 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:38.650556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ea473757-5aae-4b9a-9322-8659933a4c22 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "POST /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/action" status: 202 len: 0 microversion: 2.20 time: 0.101180 May 10 20:05:38.651158 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 424/826] 10.222.0.57 () {62 vars in 1318 bytes} [Tue May 10 20:05:38 2022] POST /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:05:38.660362 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-afbc4b60-3d67-4e11-99dd-e2559d6a486e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:38.661023 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-afbc4b60-3d67-4e11-99dd-e2559d6a486e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:38.668586 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-afbc4b60-3d67-4e11-99dd-e2559d6a486e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:38.669041 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-afbc4b60-3d67-4e11-99dd-e2559d6a486e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:38.669818 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-afbc4b60-3d67-4e11-99dd-e2559d6a486e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:38.670260 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-afbc4b60-3d67-4e11-99dd-e2559d6a486e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:38.799762 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-afbc4b60-3d67-4e11-99dd-e2559d6a486e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:38.808100 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-afbc4b60-3d67-4e11-99dd-e2559d6a486e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:38.809621 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-afbc4b60-3d67-4e11-99dd-e2559d6a486e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:38.810823 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-afbc4b60-3d67-4e11-99dd-e2559d6a486e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1672 microversion: 2.20 time: 0.155036 May 10 20:05:38.811394 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 403/827] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:38 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:39.829706 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8c7c1488-3dec-4ed3-a325-a3662ce0060e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:39.830432 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8c7c1488-3dec-4ed3-a325-a3662ce0060e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:39.836356 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8c7c1488-3dec-4ed3-a325-a3662ce0060e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:39.836812 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8c7c1488-3dec-4ed3-a325-a3662ce0060e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:39.837585 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8c7c1488-3dec-4ed3-a325-a3662ce0060e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:39.838023 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8c7c1488-3dec-4ed3-a325-a3662ce0060e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:39.965836 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8c7c1488-3dec-4ed3-a325-a3662ce0060e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:39.973690 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8c7c1488-3dec-4ed3-a325-a3662ce0060e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:39.975222 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8c7c1488-3dec-4ed3-a325-a3662ce0060e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:39.976365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8c7c1488-3dec-4ed3-a325-a3662ce0060e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.151099 May 10 20:05:39.976923 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 425/828] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:39 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:40.994957 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-66ed0735-c5c3-48d0-b7c5-fffc4eb901d5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:40.996167 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-66ed0735-c5c3-48d0-b7c5-fffc4eb901d5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:41.002822 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-66ed0735-c5c3-48d0-b7c5-fffc4eb901d5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:41.003310 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-66ed0735-c5c3-48d0-b7c5-fffc4eb901d5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:41.004104 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-66ed0735-c5c3-48d0-b7c5-fffc4eb901d5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:41.004547 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-66ed0735-c5c3-48d0-b7c5-fffc4eb901d5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:41.142640 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-66ed0735-c5c3-48d0-b7c5-fffc4eb901d5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:41.161255 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-66ed0735-c5c3-48d0-b7c5-fffc4eb901d5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:41.163423 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-66ed0735-c5c3-48d0-b7c5-fffc4eb901d5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:41.165192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-66ed0735-c5c3-48d0-b7c5-fffc4eb901d5 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.173816 May 10 20:05:41.165794 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 404/829] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:40 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:42.185263 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8a48d995-5d57-41db-b2f9-c6ae8332c932 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:42.187175 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8a48d995-5d57-41db-b2f9-c6ae8332c932 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:42.193858 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a48d995-5d57-41db-b2f9-c6ae8332c932 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:42.194601 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a48d995-5d57-41db-b2f9-c6ae8332c932 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:42.195558 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a48d995-5d57-41db-b2f9-c6ae8332c932 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:42.195988 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a48d995-5d57-41db-b2f9-c6ae8332c932 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:42.410702 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8a48d995-5d57-41db-b2f9-c6ae8332c932 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:42.423603 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8a48d995-5d57-41db-b2f9-c6ae8332c932 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:42.426087 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8a48d995-5d57-41db-b2f9-c6ae8332c932 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:42.428051 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8a48d995-5d57-41db-b2f9-c6ae8332c932 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.247568 May 10 20:05:42.439983 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 426/830] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:42 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:43.447135 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cdafcb95-a239-44e3-b3b1-6d932ffa4233 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:43.448526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cdafcb95-a239-44e3-b3b1-6d932ffa4233 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:43.461318 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cdafcb95-a239-44e3-b3b1-6d932ffa4233 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:43.462048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cdafcb95-a239-44e3-b3b1-6d932ffa4233 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:43.463179 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cdafcb95-a239-44e3-b3b1-6d932ffa4233 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:43.464244 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cdafcb95-a239-44e3-b3b1-6d932ffa4233 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:43.677193 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cdafcb95-a239-44e3-b3b1-6d932ffa4233 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:43.687834 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cdafcb95-a239-44e3-b3b1-6d932ffa4233 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:43.689810 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cdafcb95-a239-44e3-b3b1-6d932ffa4233 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:43.691286 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cdafcb95-a239-44e3-b3b1-6d932ffa4233 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.248741 May 10 20:05:43.704668 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 405/831] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:43 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:44.710389 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-55e6e474-7dea-4ac6-9469-d92f175a5b7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:44.711097 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-55e6e474-7dea-4ac6-9469-d92f175a5b7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:44.719723 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-55e6e474-7dea-4ac6-9469-d92f175a5b7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:44.720179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-55e6e474-7dea-4ac6-9469-d92f175a5b7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:44.720958 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-55e6e474-7dea-4ac6-9469-d92f175a5b7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:44.723294 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-55e6e474-7dea-4ac6-9469-d92f175a5b7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:44.989334 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-55e6e474-7dea-4ac6-9469-d92f175a5b7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:45.004051 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-55e6e474-7dea-4ac6-9469-d92f175a5b7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:45.005574 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-55e6e474-7dea-4ac6-9469-d92f175a5b7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:45.007568 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-55e6e474-7dea-4ac6-9469-d92f175a5b7c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.301076 May 10 20:05:45.009786 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 427/832] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:44 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:46.031588 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d37c3648-8e5e-4690-9835-9eabd5957872 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:46.033088 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d37c3648-8e5e-4690-9835-9eabd5957872 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:46.040555 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d37c3648-8e5e-4690-9835-9eabd5957872 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:46.041369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d37c3648-8e5e-4690-9835-9eabd5957872 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:46.042976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d37c3648-8e5e-4690-9835-9eabd5957872 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:46.043673 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d37c3648-8e5e-4690-9835-9eabd5957872 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:46.275965 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d37c3648-8e5e-4690-9835-9eabd5957872 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:46.289303 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d37c3648-8e5e-4690-9835-9eabd5957872 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:46.291252 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d37c3648-8e5e-4690-9835-9eabd5957872 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:46.295062 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d37c3648-8e5e-4690-9835-9eabd5957872 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.268610 May 10 20:05:46.297588 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 406/833] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:46 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:47.316202 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1fea70db-37e9-4808-acf4-2001f881c9b1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:47.317620 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1fea70db-37e9-4808-acf4-2001f881c9b1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:47.328263 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1fea70db-37e9-4808-acf4-2001f881c9b1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:47.330613 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1fea70db-37e9-4808-acf4-2001f881c9b1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:47.333731 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1fea70db-37e9-4808-acf4-2001f881c9b1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:47.334474 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1fea70db-37e9-4808-acf4-2001f881c9b1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:47.603892 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1fea70db-37e9-4808-acf4-2001f881c9b1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:47.615783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1fea70db-37e9-4808-acf4-2001f881c9b1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:47.619378 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1fea70db-37e9-4808-acf4-2001f881c9b1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:47.622573 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1fea70db-37e9-4808-acf4-2001f881c9b1 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.309380 May 10 20:05:47.634388 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 428/834] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:47 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:05:48.642029 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a637f756-d950-4074-8560-cdcc757cbb4e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:48.642812 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a637f756-d950-4074-8560-cdcc757cbb4e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:48.649834 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a637f756-d950-4074-8560-cdcc757cbb4e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:48.650286 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a637f756-d950-4074-8560-cdcc757cbb4e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:48.651239 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a637f756-d950-4074-8560-cdcc757cbb4e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:48.651671 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a637f756-d950-4074-8560-cdcc757cbb4e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:48.830584 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a637f756-d950-4074-8560-cdcc757cbb4e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:48.858654 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a637f756-d950-4074-8560-cdcc757cbb4e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:48.868179 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a637f756-d950-4074-8560-cdcc757cbb4e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:48.869722 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a637f756-d950-4074-8560-cdcc757cbb4e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.231784 May 10 20:05:48.870442 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 407/835] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:48 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:05:49.889756 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f6e68708-b4d6-4a60-a707-0bc0f1b1d4ed tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:49.890370 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f6e68708-b4d6-4a60-a707-0bc0f1b1d4ed tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:49.896926 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6e68708-b4d6-4a60-a707-0bc0f1b1d4ed tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:49.897390 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6e68708-b4d6-4a60-a707-0bc0f1b1d4ed tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:49.898231 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6e68708-b4d6-4a60-a707-0bc0f1b1d4ed tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:49.898712 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6e68708-b4d6-4a60-a707-0bc0f1b1d4ed tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:50.042132 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f6e68708-b4d6-4a60-a707-0bc0f1b1d4ed tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:50.052097 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f6e68708-b4d6-4a60-a707-0bc0f1b1d4ed tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:50.053666 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f6e68708-b4d6-4a60-a707-0bc0f1b1d4ed tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:50.055383 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f6e68708-b4d6-4a60-a707-0bc0f1b1d4ed tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.170037 May 10 20:05:50.056267 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 429/836] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:49 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:51.074886 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-07165b4c-19c4-42ba-b076-c0a8f7d93535 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:51.075588 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-07165b4c-19c4-42ba-b076-c0a8f7d93535 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:51.082052 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07165b4c-19c4-42ba-b076-c0a8f7d93535 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:51.082772 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07165b4c-19c4-42ba-b076-c0a8f7d93535 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:51.083727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07165b4c-19c4-42ba-b076-c0a8f7d93535 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:51.084331 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07165b4c-19c4-42ba-b076-c0a8f7d93535 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:51.314151 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-07165b4c-19c4-42ba-b076-c0a8f7d93535 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:51.323036 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-07165b4c-19c4-42ba-b076-c0a8f7d93535 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:51.326723 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-07165b4c-19c4-42ba-b076-c0a8f7d93535 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:51.328685 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-07165b4c-19c4-42ba-b076-c0a8f7d93535 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.258245 May 10 20:05:51.329527 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 408/837] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:51 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:52.347754 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cc1e0dd9-19a8-4f81-9426-87d4cc19915e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:52.348374 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cc1e0dd9-19a8-4f81-9426-87d4cc19915e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:52.361027 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc1e0dd9-19a8-4f81-9426-87d4cc19915e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:52.361485 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc1e0dd9-19a8-4f81-9426-87d4cc19915e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:52.362324 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc1e0dd9-19a8-4f81-9426-87d4cc19915e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:52.362782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc1e0dd9-19a8-4f81-9426-87d4cc19915e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:52.541144 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cc1e0dd9-19a8-4f81-9426-87d4cc19915e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:52.554156 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cc1e0dd9-19a8-4f81-9426-87d4cc19915e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:52.557014 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cc1e0dd9-19a8-4f81-9426-87d4cc19915e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:52.559049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cc1e0dd9-19a8-4f81-9426-87d4cc19915e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.214644 May 10 20:05:52.560468 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 430/838] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:52 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:53.578366 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8127c51a-83cb-4da0-b7df-6ccf0ba8c22c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:53.579775 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8127c51a-83cb-4da0-b7df-6ccf0ba8c22c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:53.591776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8127c51a-83cb-4da0-b7df-6ccf0ba8c22c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:53.592836 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8127c51a-83cb-4da0-b7df-6ccf0ba8c22c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:53.593857 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8127c51a-83cb-4da0-b7df-6ccf0ba8c22c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:53.594501 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8127c51a-83cb-4da0-b7df-6ccf0ba8c22c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:54.133600 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-5f997a95-4d68-4b32-9bf2-01bd1c36a6ef req-5bc7bd46-91a9-4e8f-b188-f1d43451681f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5", "name": "network-vif-plugged", "status": "completed", "tag": "ce79326e-c370-40ae-ba6d-04bd30bc39a2"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:05:54.145291 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-5f997a95-4d68-4b32-9bf2-01bd1c36a6ef req-5bc7bd46-91a9-4e8f-b188-f1d43451681f service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:54.145770 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-5f997a95-4d68-4b32-9bf2-01bd1c36a6ef req-5bc7bd46-91a9-4e8f-b188-f1d43451681f service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:54.164934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-5f997a95-4d68-4b32-9bf2-01bd1c36a6ef req-5bc7bd46-91a9-4e8f-b188-f1d43451681f service nova] Creating event network-vif-plugged:ce79326e-c370-40ae-ba6d-04bd30bc39a2 for instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 on hv-cinder-84131 May 10 20:05:54.175909 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-5f997a95-4d68-4b32-9bf2-01bd1c36a6ef req-5bc7bd46-91a9-4e8f-b188-f1d43451681f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045816 May 10 20:05:54.177154 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 431/839] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:05:54.266519 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8127c51a-83cb-4da0-b7df-6ccf0ba8c22c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:54.277545 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8127c51a-83cb-4da0-b7df-6ccf0ba8c22c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:54.281655 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8127c51a-83cb-4da0-b7df-6ccf0ba8c22c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:54.284665 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8127c51a-83cb-4da0-b7df-6ccf0ba8c22c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.709479 May 10 20:05:54.285480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 409/840] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:53 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:54.937715 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cafac7f5-2da8-4807-a0ba-c037b39947d6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Action: 'create', calling method: .version_select at 0x7fdd39056160>, body: {"keypair": {"name": "tempest-TestShelveInstance-694685838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGGA5zfZhWAYlCegQcpy9Q4v6boCfPotSuq0WIJFBPE3KqB4Fu6fp5L4ZXIney3Uqslel1CO0KJBQo6SAw065wvMJbINDUAGthdiOXzJivZT7QgN/SIY9SMUEEbM42VEg=="}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:05:54.951269 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-cafac7f5-2da8-4807-a0ba-c037b39947d6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Getting quotas for project 4d8820e6b7a04ca89202e7b7ed991f9a. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:05:54.955055 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-cafac7f5-2da8-4807-a0ba-c037b39947d6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Getting quotas for user 48870723aed043be9db4f5923a05e8c2 and project 4d8820e6b7a04ca89202e7b7ed991f9a. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:05:54.976455 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cafac7f5-2da8-4807-a0ba-c037b39947d6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.202230 May 10 20:05:54.977054 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 432/841] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 20:05:54 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:05:55.304469 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-bf0a897c-f134-4f45-ba5b-eed19b450041 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:55.306226 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-bf0a897c-f134-4f45-ba5b-eed19b450041 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:55.313500 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bf0a897c-f134-4f45-ba5b-eed19b450041 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:55.314376 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bf0a897c-f134-4f45-ba5b-eed19b450041 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:55.315358 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bf0a897c-f134-4f45-ba5b-eed19b450041 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:55.315840 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bf0a897c-f134-4f45-ba5b-eed19b450041 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:55.460843 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-bf0a897c-f134-4f45-ba5b-eed19b450041 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:55.471073 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-bf0a897c-f134-4f45-ba5b-eed19b450041 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:55.473033 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-bf0a897c-f134-4f45-ba5b-eed19b450041 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:55.474548 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-bf0a897c-f134-4f45-ba5b-eed19b450041 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.174611 May 10 20:05:55.475835 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 410/842] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:55 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:56.495253 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-aa1762bf-868a-4b44-87e4-8d0c4fa5b2e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:56.496821 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-aa1762bf-868a-4b44-87e4-8d0c4fa5b2e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:56.504587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aa1762bf-868a-4b44-87e4-8d0c4fa5b2e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:56.505138 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aa1762bf-868a-4b44-87e4-8d0c4fa5b2e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:56.506167 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aa1762bf-868a-4b44-87e4-8d0c4fa5b2e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:56.506772 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aa1762bf-868a-4b44-87e4-8d0c4fa5b2e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:56.660495 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-aa1762bf-868a-4b44-87e4-8d0c4fa5b2e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:56.669476 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-aa1762bf-868a-4b44-87e4-8d0c4fa5b2e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:56.671978 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-aa1762bf-868a-4b44-87e4-8d0c4fa5b2e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:56.673483 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-aa1762bf-868a-4b44-87e4-8d0c4fa5b2e9 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1730 microversion: 2.20 time: 0.183772 May 10 20:05:56.674163 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 433/843] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:56 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:05:57.692366 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-34f23d96-c9ca-469f-8b31-0dface2c161d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:05:57.692988 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-34f23d96-c9ca-469f-8b31-0dface2c161d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:05:57.705647 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-34f23d96-c9ca-469f-8b31-0dface2c161d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:57.706103 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-34f23d96-c9ca-469f-8b31-0dface2c161d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:57.706928 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-34f23d96-c9ca-469f-8b31-0dface2c161d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:05:57.707372 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-34f23d96-c9ca-469f-8b31-0dface2c161d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:05:57.842392 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-34f23d96-c9ca-469f-8b31-0dface2c161d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:57.853789 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-34f23d96-c9ca-469f-8b31-0dface2c161d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:57.855620 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-34f23d96-c9ca-469f-8b31-0dface2c161d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:05:57.857104 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-34f23d96-c9ca-469f-8b31-0dface2c161d tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1717 microversion: 2.20 time: 0.168653 May 10 20:05:57.857959 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 411/844] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:05:57 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1717 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:06:04.085719 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4b057b37-7100-4a20-bc15-0a4ff6d99e21 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:04.086257 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4b057b37-7100-4a20-bc15-0a4ff6d99e21 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:04.087900 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-0db7555f-24f7-445f-bace-75b32be07eb6 req-28eb2602-6a3b-433f-9861-224f836acf13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ba59142-196f-4c2d-9795-fdeba5da92e3", "tag": "b394e984-72e7-4807-85f2-d6717d5ed1e4"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:06:04.094321 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4b057b37-7100-4a20-bc15-0a4ff6d99e21 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:04.094892 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4b057b37-7100-4a20-bc15-0a4ff6d99e21 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:04.095749 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4b057b37-7100-4a20-bc15-0a4ff6d99e21 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:04.096261 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4b057b37-7100-4a20-bc15-0a4ff6d99e21 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:04.097167 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-0db7555f-24f7-445f-bace-75b32be07eb6 req-28eb2602-6a3b-433f-9861-224f836acf13 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:04.097622 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-0db7555f-24f7-445f-bace-75b32be07eb6 req-28eb2602-6a3b-433f-9861-224f836acf13 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:04.109023 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-0db7555f-24f7-445f-bace-75b32be07eb6 req-28eb2602-6a3b-433f-9861-224f836acf13 service nova] Creating event network-changed:b394e984-72e7-4807-85f2-d6717d5ed1e4 for instance 6ba59142-196f-4c2d-9795-fdeba5da92e3 on hv-cinder-84131 May 10 20:06:04.116000 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-0db7555f-24f7-445f-bace-75b32be07eb6 req-28eb2602-6a3b-433f-9861-224f836acf13 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031152 May 10 20:06:04.119305 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 412/845] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:06:04.123206 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4b057b37-7100-4a20-bc15-0a4ff6d99e21 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:06:04.222057 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4b057b37-7100-4a20-bc15-0a4ff6d99e21 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 204 len: 0 microversion: 2.1 time: 0.140129 May 10 20:06:04.226010 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 434/846] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:06:04 2022] DELETE /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:06:04.231813 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-438d7fab-94c3-4fb2-a359-db390c94a9c7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:04.232574 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-438d7fab-94c3-4fb2-a359-db390c94a9c7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:04.239102 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-438d7fab-94c3-4fb2-a359-db390c94a9c7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:04.239575 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-438d7fab-94c3-4fb2-a359-db390c94a9c7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:04.240318 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-438d7fab-94c3-4fb2-a359-db390c94a9c7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:04.240752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-438d7fab-94c3-4fb2-a359-db390c94a9c7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:04.397392 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-438d7fab-94c3-4fb2-a359-db390c94a9c7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:04.405011 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-438d7fab-94c3-4fb2-a359-db390c94a9c7 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1576 microversion: 2.1 time: 0.177530 May 10 20:06:04.405594 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 413/847] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:04 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:05.424292 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2e97db22-a9f5-412f-ae18-d0cf44ac961d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:05.425000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2e97db22-a9f5-412f-ae18-d0cf44ac961d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:05.431423 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e97db22-a9f5-412f-ae18-d0cf44ac961d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:05.431881 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e97db22-a9f5-412f-ae18-d0cf44ac961d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:05.432654 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e97db22-a9f5-412f-ae18-d0cf44ac961d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:05.433095 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e97db22-a9f5-412f-ae18-d0cf44ac961d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:05.566998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e97db22-a9f5-412f-ae18-d0cf44ac961d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:05.574343 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2e97db22-a9f5-412f-ae18-d0cf44ac961d tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1576 microversion: 2.1 time: 0.154395 May 10 20:06:05.575206 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 435/848] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:05 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:06.402377 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-942392b3-0097-44f8-865e-8fe498d73fb1 req-54b510a5-91eb-434b-9554-bc0aa0eeaa4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ba59142-196f-4c2d-9795-fdeba5da92e3", "name": "network-vif-deleted", "tag": "b394e984-72e7-4807-85f2-d6717d5ed1e4"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:06:06.412914 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-942392b3-0097-44f8-865e-8fe498d73fb1 req-54b510a5-91eb-434b-9554-bc0aa0eeaa4f service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:06.413536 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-942392b3-0097-44f8-865e-8fe498d73fb1 req-54b510a5-91eb-434b-9554-bc0aa0eeaa4f service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:06.428031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-942392b3-0097-44f8-865e-8fe498d73fb1 req-54b510a5-91eb-434b-9554-bc0aa0eeaa4f service nova] Creating event network-vif-deleted:b394e984-72e7-4807-85f2-d6717d5ed1e4 for instance 6ba59142-196f-4c2d-9795-fdeba5da92e3 on hv-cinder-84131 May 10 20:06:06.432843 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-942392b3-0097-44f8-865e-8fe498d73fb1 req-54b510a5-91eb-434b-9554-bc0aa0eeaa4f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034117 May 10 20:06:06.433434 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 414/849] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:06:06.592526 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b3f2f555-f55b-4117-b59c-590f88853fbc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:06.593186 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b3f2f555-f55b-4117-b59c-590f88853fbc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:06.599116 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3f2f555-f55b-4117-b59c-590f88853fbc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:06.599576 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3f2f555-f55b-4117-b59c-590f88853fbc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:06.600352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3f2f555-f55b-4117-b59c-590f88853fbc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:06.600798 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b3f2f555-f55b-4117-b59c-590f88853fbc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:06.662772 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b3f2f555-f55b-4117-b59c-590f88853fbc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:06.671137 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b3f2f555-f55b-4117-b59c-590f88853fbc tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 200 len: 1224 microversion: 2.1 time: 0.082979 May 10 20:06:06.672083 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 436/850] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:06 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:07.689776 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-00dfe527-d530-475d-8b82-c3a3df3d6dd0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:07.690500 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-00dfe527-d530-475d-8b82-c3a3df3d6dd0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 6ba59142-196f-4c2d-9795-fdeba5da92e3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:07.696605 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00dfe527-d530-475d-8b82-c3a3df3d6dd0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:07.697064 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00dfe527-d530-475d-8b82-c3a3df3d6dd0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:07.697830 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00dfe527-d530-475d-8b82-c3a3df3d6dd0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:07.698271 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00dfe527-d530-475d-8b82-c3a3df3d6dd0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:07.711146 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-00dfe527-d530-475d-8b82-c3a3df3d6dd0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] HTTP exception thrown: Instance 6ba59142-196f-4c2d-9795-fdeba5da92e3 could not be found. May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-00dfe527-d530-475d-8b82-c3a3df3d6dd0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Request method failure captured: May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 HTTP/1.1 May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesP7_wauQeN8SjuwdRP3sqBNlKqBu30ouXDPMYL9nQAUfxPGEihQnFdxB2AVzRhQWqtV0av6vdH4XOMNtOMXIs9uQxGZaz-2F9QC1BpAjHYL8wGwIA7xDNKJ2EBaju-u4OOiqxZK4Xz2GWvdpmbrB9QruDhXq-9slnILrQftaSqfvcM May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 493768250fbb449a8b5430992e76b60f May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-TestVolumeBootPattern-373508332 May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:06:07.712769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/493768250fbb449a8b5430992e76b60f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_493768250fbb449a8b5430992e76b60f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/493768250fbb449a8b5430992e76b60f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/493768250fbb449a8b5430992e76b60f"}]}] May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-TestVolumeBootPattern-373508332 May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 493768250fbb449a8b5430992e76b60f May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-TestVolumeBootPattern-373508332 May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-TestVolumeBootPattern-373508332-project May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: be0ebfb74d254359b4dfa36d9aff4ac6 May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-TestVolumeBootPattern-373508332-project May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 6ba59142-196f-4c2d-9795-fdeba5da92e3 could not be found. May 10 20:06:07.715935 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '6ba59142-196f-4c2d-9795-fdeba5da92e3'} May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ba59142-196f-4c2d-9795-fdeba5da92e3 could not be found. May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:06:07.716879 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ba59142-196f-4c2d-9795-fdeba5da92e3 could not be found. May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ba59142-196f-4c2d-9795-fdeba5da92e3 could not be found. May 10 20:06:07.718490 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:07.719988 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-00dfe527-d530-475d-8b82-c3a3df3d6dd0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Returning 404 to user: Instance 6ba59142-196f-4c2d-9795-fdeba5da92e3 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:06:07.719988 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-00dfe527-d530-475d-8b82-c3a3df3d6dd0 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3" status: 404 len: 111 microversion: 2.1 time: 0.029817 May 10 20:06:07.719988 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 415/851] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:07 2022] GET /compute/v2.1/servers/6ba59142-196f-4c2d-9795-fdeba5da92e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:06:10.065161 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1490956185", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-694685838", "security_groups": [{"name": "tempest-secgroup-smoke-1926417321"}], "networks": [{"uuid": "9ace4159-a089-42d1-becf-be8ae15fda3c"}], "block_device_mapping_v2": [{"uuid": "e01ebdf8-f09b-42bb-a87e-571bca6cc349", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:06:10.178924 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] validate_networks() for [('9ace4159-a089-42d1-becf-be8ae15fda3c', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:06:10.787616 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:06:10.788045 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:06:10.788550 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:06:10.788958 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:06:10.789370 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:06:10.792110 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fa74bed8-a331-42cf-83dc-c9b80b66431a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:10.792682 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fa74bed8-a331-42cf-83dc-c9b80b66431a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:10.798850 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:10.799048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa74bed8-a331-42cf-83dc-c9b80b66431a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:10.799304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:10.799425 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa74bed8-a331-42cf-83dc-c9b80b66431a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:10.800111 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:10.800223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa74bed8-a331-42cf-83dc-c9b80b66431a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:10.800551 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:10.800732 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa74bed8-a331-42cf-83dc-c9b80b66431a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:10.817495 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Getting quotas for project 4d8820e6b7a04ca89202e7b7ed991f9a. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:06:10.821343 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Getting quotas for user 48870723aed043be9db4f5923a05e8c2 and project 4d8820e6b7a04ca89202e7b7ed991f9a. Resources: {'instances', 'ram', 'cores'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:06:10.827604 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fa74bed8-a331-42cf-83dc-c9b80b66431a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:06:10.879749 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:06:10.881832 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e01ebdf8-f09b-42bb-a87e-571bca6cc349',volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:06:10.914338 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fa74bed8-a331-42cf-83dc-c9b80b66431a tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "DELETE /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 204 len: 0 microversion: 2.1 time: 0.125554 May 10 20:06:10.915126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 416/852] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:06:10 2022] DELETE /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:06:10.921619 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-e24eb8e5-3640-4e13-b88c-7be7801acd90 req-2214b885-6fa0-43ac-a8ac-5569ad997931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378c7384-2154-4589-a6f1-460252ad7fbb", "tag": "3861263d-5b70-4336-8929-4965baec17b5"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:06:10.930355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e24eb8e5-3640-4e13-b88c-7be7801acd90 req-2214b885-6fa0-43ac-a8ac-5569ad997931 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:10.930827 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e24eb8e5-3640-4e13-b88c-7be7801acd90 req-2214b885-6fa0-43ac-a8ac-5569ad997931 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:10.944172 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-e24eb8e5-3640-4e13-b88c-7be7801acd90 req-2214b885-6fa0-43ac-a8ac-5569ad997931 service nova] Creating event network-changed:3861263d-5b70-4336-8929-4965baec17b5 for instance 378c7384-2154-4589-a6f1-460252ad7fbb on hv-cinder-84131 May 10 20:06:10.949633 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-e24eb8e5-3640-4e13-b88c-7be7801acd90 req-2214b885-6fa0-43ac-a8ac-5569ad997931 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032973 May 10 20:06:10.954110 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 417/853] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:06:10.959170 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-800fe83b-f470-4d98-9cd2-0c541af580aa tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:10.959861 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-800fe83b-f470-4d98-9cd2-0c541af580aa tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:10.966003 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-800fe83b-f470-4d98-9cd2-0c541af580aa tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:10.966483 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-800fe83b-f470-4d98-9cd2-0c541af580aa tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:10.967256 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-800fe83b-f470-4d98-9cd2-0c541af580aa tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:10.967749 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-800fe83b-f470-4d98-9cd2-0c541af580aa tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:11.026547 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9be9c5c8-e56f-42b8-9ab0-d5ef1a19dfed tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.965152 May 10 20:06:11.027450 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 437/854] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:06:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:06:11.039422 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-36a68e5d-c2d3-498a-b811-97cb9057d742 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:11.041329 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-36a68e5d-c2d3-498a-b811-97cb9057d742 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:11.103668 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-36a68e5d-c2d3-498a-b811-97cb9057d742 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:11.112871 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-36a68e5d-c2d3-498a-b811-97cb9057d742 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1088 microversion: 2.1 time: 0.078835 May 10 20:06:11.114240 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 438/855] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:11 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:11.120384 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-800fe83b-f470-4d98-9cd2-0c541af580aa tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:11.133181 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-800fe83b-f470-4d98-9cd2-0c541af580aa tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1577 microversion: 2.1 time: 0.177818 May 10 20:06:11.134054 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 418/856] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:10 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:12.130594 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-528196e6-48cf-4b81-a096-b2050f33a69a tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:12.131165 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-528196e6-48cf-4b81-a096-b2050f33a69a tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:12.137591 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-528196e6-48cf-4b81-a096-b2050f33a69a tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:12.138046 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-528196e6-48cf-4b81-a096-b2050f33a69a tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:12.138879 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-528196e6-48cf-4b81-a096-b2050f33a69a tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:12.139322 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-528196e6-48cf-4b81-a096-b2050f33a69a tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:12.150829 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b0e41bd0-f3bb-4081-962f-73d210af2635 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:12.151446 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b0e41bd0-f3bb-4081-962f-73d210af2635 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:12.158356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0e41bd0-f3bb-4081-962f-73d210af2635 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:12.158861 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0e41bd0-f3bb-4081-962f-73d210af2635 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:12.159633 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0e41bd0-f3bb-4081-962f-73d210af2635 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:12.160075 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0e41bd0-f3bb-4081-962f-73d210af2635 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:12.206523 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-528196e6-48cf-4b81-a096-b2050f33a69a tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:12.214689 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-528196e6-48cf-4b81-a096-b2050f33a69a tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1138 microversion: 2.1 time: 0.087995 May 10 20:06:12.224990 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 439/857] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:12 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:12.731920 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b0e41bd0-f3bb-4081-962f-73d210af2635 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:12.739542 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b0e41bd0-f3bb-4081-962f-73d210af2635 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1577 microversion: 2.1 time: 0.592474 May 10 20:06:12.740145 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 419/858] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:12 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1577 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:06:13.232440 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-40269a4e-3be8-4f45-90b5-ffc29e5b76ce tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:13.234261 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-40269a4e-3be8-4f45-90b5-ffc29e5b76ce tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:13.241666 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-40269a4e-3be8-4f45-90b5-ffc29e5b76ce tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:13.242530 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-40269a4e-3be8-4f45-90b5-ffc29e5b76ce tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:13.243600 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-40269a4e-3be8-4f45-90b5-ffc29e5b76ce tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:13.244330 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-40269a4e-3be8-4f45-90b5-ffc29e5b76ce tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:13.412047 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-40269a4e-3be8-4f45-90b5-ffc29e5b76ce tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:13.422625 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-40269a4e-3be8-4f45-90b5-ffc29e5b76ce tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1204 microversion: 2.1 time: 0.193882 May 10 20:06:13.424523 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 440/859] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:13 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1204 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:13.656913 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-1e0dfca1-1507-42eb-ad9c-584f0e0144e7 req-0c04b5f3-d826-4b8f-9bab-e4947d142a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378c7384-2154-4589-a6f1-460252ad7fbb", "name": "network-vif-deleted", "tag": "3861263d-5b70-4336-8929-4965baec17b5"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:06:13.673942 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-1e0dfca1-1507-42eb-ad9c-584f0e0144e7 req-0c04b5f3-d826-4b8f-9bab-e4947d142a77 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:13.674375 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-1e0dfca1-1507-42eb-ad9c-584f0e0144e7 req-0c04b5f3-d826-4b8f-9bab-e4947d142a77 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:13.686119 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-1e0dfca1-1507-42eb-ad9c-584f0e0144e7 req-0c04b5f3-d826-4b8f-9bab-e4947d142a77 service nova] Creating event network-vif-deleted:3861263d-5b70-4336-8929-4965baec17b5 for instance 378c7384-2154-4589-a6f1-460252ad7fbb on hv-cinder-84131 May 10 20:06:13.692642 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-1e0dfca1-1507-42eb-ad9c-584f0e0144e7 req-0c04b5f3-d826-4b8f-9bab-e4947d142a77 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041451 May 10 20:06:13.694021 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 420/860] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:06:13.757564 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-88d47ee6-114f-4f13-8e7e-8b276f5382c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:13.758307 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-88d47ee6-114f-4f13-8e7e-8b276f5382c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:13.766143 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-88d47ee6-114f-4f13-8e7e-8b276f5382c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:13.770290 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-88d47ee6-114f-4f13-8e7e-8b276f5382c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:13.771172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-88d47ee6-114f-4f13-8e7e-8b276f5382c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:13.771843 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-88d47ee6-114f-4f13-8e7e-8b276f5382c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:13.848887 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-88d47ee6-114f-4f13-8e7e-8b276f5382c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0ebfb74d254359b4dfa36d9aff4ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493768250fbb449a8b5430992e76b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:13.857277 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-88d47ee6-114f-4f13-8e7e-8b276f5382c2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 200 len: 1225 microversion: 2.1 time: 0.104898 May 10 20:06:13.857877 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 441/861] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:13 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:14.443241 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4496ead4-ad95-4019-ab2b-8ad5f6320a4e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:14.444623 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4496ead4-ad95-4019-ab2b-8ad5f6320a4e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:14.454426 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4496ead4-ad95-4019-ab2b-8ad5f6320a4e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:14.455465 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4496ead4-ad95-4019-ab2b-8ad5f6320a4e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:14.456539 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4496ead4-ad95-4019-ab2b-8ad5f6320a4e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:14.457253 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4496ead4-ad95-4019-ab2b-8ad5f6320a4e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:14.515080 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-c23fbcde-337d-4b0c-8b70-6c90d576341a req-db134ba7-b31d-4724-8b15-04e50df8b8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee2f0ef-9109-4453-9767-472abca04ffe", "tag": "59264579-f015-4414-9410-630bf057f4aa"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:06:14.528963 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-c23fbcde-337d-4b0c-8b70-6c90d576341a req-db134ba7-b31d-4724-8b15-04e50df8b8b5 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:14.529355 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-c23fbcde-337d-4b0c-8b70-6c90d576341a req-db134ba7-b31d-4724-8b15-04e50df8b8b5 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:14.544073 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-c23fbcde-337d-4b0c-8b70-6c90d576341a req-db134ba7-b31d-4724-8b15-04e50df8b8b5 service nova] Creating event network-changed:59264579-f015-4414-9410-630bf057f4aa for instance 9ee2f0ef-9109-4453-9767-472abca04ffe on hv-cinder-84131 May 10 20:06:14.550642 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-c23fbcde-337d-4b0c-8b70-6c90d576341a req-db134ba7-b31d-4724-8b15-04e50df8b8b5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040102 May 10 20:06:14.551257 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 442/862] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:06:14.641168 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4496ead4-ad95-4019-ab2b-8ad5f6320a4e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:14.649326 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4496ead4-ad95-4019-ab2b-8ad5f6320a4e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1260 microversion: 2.1 time: 0.212335 May 10 20:06:14.650177 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 421/863] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:14 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:14.874283 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-246ab10d-0a52-4b13-8358-be5bbe34754e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:14.875027 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-246ab10d-0a52-4b13-8358-be5bbe34754e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 378c7384-2154-4589-a6f1-460252ad7fbb] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:14.881565 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-246ab10d-0a52-4b13-8358-be5bbe34754e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:14.882027 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-246ab10d-0a52-4b13-8358-be5bbe34754e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:14.882841 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-246ab10d-0a52-4b13-8358-be5bbe34754e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:14.883279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-246ab10d-0a52-4b13-8358-be5bbe34754e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:14.900854 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-246ab10d-0a52-4b13-8358-be5bbe34754e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] HTTP exception thrown: Instance 378c7384-2154-4589-a6f1-460252ad7fbb could not be found. May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-246ab10d-0a52-4b13-8358-be5bbe34754e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Request method failure captured: May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb HTTP/1.1 May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesP7_wauQeN8SjuwdRP3sqBNlKqBu30ouXDPMYL9nQAUfxPGEihQnFdxB2AVzRhQWqtV0av6vdH4XOMNtOMXIs9uQxGZaz-2F9QC1BpAjHYL8wGwIA7xDNKJ2EBaju-u4OOiqxZK4Xz2GWvdpmbrB9QruDhXq-9slnILrQftaSqfvcM May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 493768250fbb449a8b5430992e76b60f May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-TestVolumeBootPattern-373508332 May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:06:14.902534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/493768250fbb449a8b5430992e76b60f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_493768250fbb449a8b5430992e76b60f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/493768250fbb449a8b5430992e76b60f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/493768250fbb449a8b5430992e76b60f"}]}] May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-TestVolumeBootPattern-373508332 May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 493768250fbb449a8b5430992e76b60f May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-TestVolumeBootPattern-373508332 May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-TestVolumeBootPattern-373508332-project May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: be0ebfb74d254359b4dfa36d9aff4ac6 May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-TestVolumeBootPattern-373508332-project May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 378c7384-2154-4589-a6f1-460252ad7fbb could not be found. May 10 20:06:14.904234 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '378c7384-2154-4589-a6f1-460252ad7fbb'} May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 378c7384-2154-4589-a6f1-460252ad7fbb could not be found. May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:06:14.905112 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 378c7384-2154-4589-a6f1-460252ad7fbb could not be found. May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 378c7384-2154-4589-a6f1-460252ad7fbb could not be found. May 10 20:06:14.907000 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:14.908237 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-246ab10d-0a52-4b13-8358-be5bbe34754e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Returning 404 to user: Instance 378c7384-2154-4589-a6f1-460252ad7fbb could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:06:14.908237 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-246ab10d-0a52-4b13-8358-be5bbe34754e tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb" status: 404 len: 111 microversion: 2.1 time: 0.033947 May 10 20:06:14.908237 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 443/864] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:14 2022] GET /compute/v2.1/servers/378c7384-2154-4589-a6f1-460252ad7fbb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:06:15.355784 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e6ff1a05-e6c7-4823-bc0e-0bf083c90da2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:15.356306 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e6ff1a05-e6c7-4823-bc0e-0bf083c90da2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:15.362590 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6ff1a05-e6c7-4823-bc0e-0bf083c90da2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:15.363050 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6ff1a05-e6c7-4823-bc0e-0bf083c90da2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:15.363827 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6ff1a05-e6c7-4823-bc0e-0bf083c90da2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:15.364534 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6ff1a05-e6c7-4823-bc0e-0bf083c90da2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:15.380129 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-e6ff1a05-e6c7-4823-bc0e-0bf083c90da2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] HTTP exception thrown: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e6ff1a05-e6c7-4823-bc0e-0bf083c90da2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Request method failure captured: May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: DELETE /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f HTTP/1.1 May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesP7_wauQeN8SjuwdRP3sqBNlKqBu30ouXDPMYL9nQAUfxPGEihQnFdxB2AVzRhQWqtV0av6vdH4XOMNtOMXIs9uQxGZaz-2F9QC1BpAjHYL8wGwIA7xDNKJ2EBaju-u4OOiqxZK4Xz2GWvdpmbrB9QruDhXq-9slnILrQftaSqfvcM May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 493768250fbb449a8b5430992e76b60f May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-TestVolumeBootPattern-373508332 May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:06:15.382369 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/493768250fbb449a8b5430992e76b60f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_493768250fbb449a8b5430992e76b60f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/493768250fbb449a8b5430992e76b60f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/493768250fbb449a8b5430992e76b60f"}]}] May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-TestVolumeBootPattern-373508332 May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 493768250fbb449a8b5430992e76b60f May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-TestVolumeBootPattern-373508332 May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-TestVolumeBootPattern-373508332-project May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: be0ebfb74d254359b4dfa36d9aff4ac6 May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-TestVolumeBootPattern-373508332-project May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:06:15.384109 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '24e0633f-fa61-4d94-8b8b-663d1a59ed6f'} May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:06:15.385496 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:06:15.387126 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:15.388663 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e6ff1a05-e6c7-4823-bc0e-0bf083c90da2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Returning 404 to user: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:06:15.388663 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e6ff1a05-e6c7-4823-bc0e-0bf083c90da2 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "DELETE /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 404 len: 111 microversion: 2.1 time: 0.034740 May 10 20:06:15.389254 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 422/865] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:06:15 2022] DELETE /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:06:15.398075 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f1fa85da-2f07-4201-9299-e1965d4640a1 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:15.398716 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f1fa85da-2f07-4201-9299-e1965d4640a1 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] [instance: 24e0633f-fa61-4d94-8b8b-663d1a59ed6f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:15.404773 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1fa85da-2f07-4201-9299-e1965d4640a1 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:15.405233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1fa85da-2f07-4201-9299-e1965d4640a1 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:15.406578 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1fa85da-2f07-4201-9299-e1965d4640a1 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:15.407021 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1fa85da-2f07-4201-9299-e1965d4640a1 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:15.421624 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-f1fa85da-2f07-4201-9299-e1965d4640a1 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] HTTP exception thrown: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f1fa85da-2f07-4201-9299-e1965d4640a1 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Request method failure captured: May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f HTTP/1.1 May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesP7_wauQeN8SjuwdRP3sqBNlKqBu30ouXDPMYL9nQAUfxPGEihQnFdxB2AVzRhQWqtV0av6vdH4XOMNtOMXIs9uQxGZaz-2F9QC1BpAjHYL8wGwIA7xDNKJ2EBaju-u4OOiqxZK4Xz2GWvdpmbrB9QruDhXq-9slnILrQftaSqfvcM May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 493768250fbb449a8b5430992e76b60f May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-TestVolumeBootPattern-373508332 May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:06:15.423182 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/493768250fbb449a8b5430992e76b60f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_493768250fbb449a8b5430992e76b60f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/493768250fbb449a8b5430992e76b60f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/493768250fbb449a8b5430992e76b60f"}]}] May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-TestVolumeBootPattern-373508332 May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 493768250fbb449a8b5430992e76b60f May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-TestVolumeBootPattern-373508332 May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-TestVolumeBootPattern-373508332-project May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: be0ebfb74d254359b4dfa36d9aff4ac6 May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-TestVolumeBootPattern-373508332-project May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:06:15.424867 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '24e0633f-fa61-4d94-8b8b-663d1a59ed6f'} May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:06:15.425775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. May 10 20:06:15.427284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:15.428569 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f1fa85da-2f07-4201-9299-e1965d4640a1 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Returning 404 to user: Instance 24e0633f-fa61-4d94-8b8b-663d1a59ed6f could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:06:15.428569 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f1fa85da-2f07-4201-9299-e1965d4640a1 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f" status: 404 len: 111 microversion: 2.1 time: 0.030399 May 10 20:06:15.428569 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 444/866] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:15 2022] GET /compute/v2.1/servers/24e0633f-fa61-4d94-8b8b-663d1a59ed6f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:06:15.667156 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a69d119f-dfd4-41bf-9345-d049e7207747 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:15.667698 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a69d119f-dfd4-41bf-9345-d049e7207747 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:15.673731 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a69d119f-dfd4-41bf-9345-d049e7207747 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:15.674188 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a69d119f-dfd4-41bf-9345-d049e7207747 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:15.675034 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a69d119f-dfd4-41bf-9345-d049e7207747 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:15.675479 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a69d119f-dfd4-41bf-9345-d049e7207747 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:15.812384 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a69d119f-dfd4-41bf-9345-d049e7207747 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:15.819602 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a69d119f-dfd4-41bf-9345-d049e7207747 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1260 microversion: 2.1 time: 0.156443 May 10 20:06:15.820175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 423/867] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:15 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:06:16.712760 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-208255ed-8e83-4db2-987a-e25c01ed0f59 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] Calling method '.version_select at 0x7fdd39222b80>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:16.735153 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-208255ed-8e83-4db2-987a-e25c01ed0f59 tempest-TestVolumeBootPattern-373508332 tempest-TestVolumeBootPattern-373508332-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-209518868" status: 202 len: 0 microversion: 2.1 time: 0.026015 May 10 20:06:16.735899 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 445/868] 10.222.0.57 () {58 vars in 1259 bytes} [Tue May 10 20:06:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-209518868 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:06:16.836491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9430af53-79c2-4401-a9a0-234e29dee36b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:16.837108 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9430af53-79c2-4401-a9a0-234e29dee36b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:16.843478 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9430af53-79c2-4401-a9a0-234e29dee36b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:16.844648 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9430af53-79c2-4401-a9a0-234e29dee36b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:16.845430 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9430af53-79c2-4401-a9a0-234e29dee36b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:16.845865 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9430af53-79c2-4401-a9a0-234e29dee36b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:16.976260 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9430af53-79c2-4401-a9a0-234e29dee36b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:16.983695 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9430af53-79c2-4401-a9a0-234e29dee36b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1260 microversion: 2.1 time: 0.151158 May 10 20:06:16.984270 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 424/869] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:16 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:18.001498 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-10c081b6-40fc-4e66-9570-711928bcbf13 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:18.002136 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-10c081b6-40fc-4e66-9570-711928bcbf13 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:18.009096 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10c081b6-40fc-4e66-9570-711928bcbf13 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:18.009590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10c081b6-40fc-4e66-9570-711928bcbf13 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:18.010360 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10c081b6-40fc-4e66-9570-711928bcbf13 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:18.010822 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10c081b6-40fc-4e66-9570-711928bcbf13 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:18.441184 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-10c081b6-40fc-4e66-9570-711928bcbf13 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:18.448582 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-10c081b6-40fc-4e66-9570-711928bcbf13 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1260 microversion: 2.1 time: 0.451906 May 10 20:06:18.449150 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 446/870] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:17 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1260 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:19.469432 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-aa36cd10-b6c3-416a-b86c-b47b68506d0f tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:19.472808 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-aa36cd10-b6c3-416a-b86c-b47b68506d0f tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:19.479963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa36cd10-b6c3-416a-b86c-b47b68506d0f tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:19.480656 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa36cd10-b6c3-416a-b86c-b47b68506d0f tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:19.481506 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa36cd10-b6c3-416a-b86c-b47b68506d0f tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:19.481955 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa36cd10-b6c3-416a-b86c-b47b68506d0f tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:19.645773 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-aa36cd10-b6c3-416a-b86c-b47b68506d0f tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:19.654975 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-aa36cd10-b6c3-416a-b86c-b47b68506d0f tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1260 microversion: 2.1 time: 0.189762 May 10 20:06:19.656198 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 425/871] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:19 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:20.673494 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0ce6c22f-2d33-434a-9af3-95b24df8d674 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:20.674035 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0ce6c22f-2d33-434a-9af3-95b24df8d674 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:20.680383 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ce6c22f-2d33-434a-9af3-95b24df8d674 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:20.680829 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ce6c22f-2d33-434a-9af3-95b24df8d674 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:20.681606 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ce6c22f-2d33-434a-9af3-95b24df8d674 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:20.682043 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ce6c22f-2d33-434a-9af3-95b24df8d674 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:20.809461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0ce6c22f-2d33-434a-9af3-95b24df8d674 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:20.816855 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0ce6c22f-2d33-434a-9af3-95b24df8d674 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1260 microversion: 2.1 time: 0.147841 May 10 20:06:20.817430 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 447/872] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:20 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:21.833241 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-93a106cb-e372-4f39-83d5-86204113d5fb tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:21.833865 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-93a106cb-e372-4f39-83d5-86204113d5fb tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:21.840235 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-93a106cb-e372-4f39-83d5-86204113d5fb tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:21.840706 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-93a106cb-e372-4f39-83d5-86204113d5fb tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:21.841483 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-93a106cb-e372-4f39-83d5-86204113d5fb tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:21.841921 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-93a106cb-e372-4f39-83d5-86204113d5fb tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:22.035938 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-93a106cb-e372-4f39-83d5-86204113d5fb tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:22.049003 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-93a106cb-e372-4f39-83d5-86204113d5fb tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1260 microversion: 2.1 time: 0.219590 May 10 20:06:22.061543 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 426/873] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:21 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:23.065857 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a3a73191-7a67-4e63-b0e0-c532a4cfbfc6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:23.066408 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a3a73191-7a67-4e63-b0e0-c532a4cfbfc6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:23.073238 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a3a73191-7a67-4e63-b0e0-c532a4cfbfc6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:23.073702 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a3a73191-7a67-4e63-b0e0-c532a4cfbfc6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:23.074506 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a3a73191-7a67-4e63-b0e0-c532a4cfbfc6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:23.074956 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a3a73191-7a67-4e63-b0e0-c532a4cfbfc6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:23.316468 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a3a73191-7a67-4e63-b0e0-c532a4cfbfc6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:23.324812 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a3a73191-7a67-4e63-b0e0-c532a4cfbfc6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1260 microversion: 2.1 time: 0.262855 May 10 20:06:23.325387 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 448/874] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:23 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:24.017620 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-439aae95-ca91-45d2-a8ca-b749d553e9e0 req-e4cb87fd-b832-4e5d-9762-58a275098691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee2f0ef-9109-4453-9767-472abca04ffe", "name": "network-vif-plugged", "status": "completed", "tag": "59264579-f015-4414-9410-630bf057f4aa"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:06:24.026722 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-439aae95-ca91-45d2-a8ca-b749d553e9e0 req-e4cb87fd-b832-4e5d-9762-58a275098691 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:24.027248 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-439aae95-ca91-45d2-a8ca-b749d553e9e0 req-e4cb87fd-b832-4e5d-9762-58a275098691 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:24.040013 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-439aae95-ca91-45d2-a8ca-b749d553e9e0 req-e4cb87fd-b832-4e5d-9762-58a275098691 service nova] Creating event network-vif-plugged:59264579-f015-4414-9410-630bf057f4aa for instance 9ee2f0ef-9109-4453-9767-472abca04ffe on hv-cinder-84131 May 10 20:06:24.045136 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-439aae95-ca91-45d2-a8ca-b749d553e9e0 req-e4cb87fd-b832-4e5d-9762-58a275098691 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031789 May 10 20:06:24.047965 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 427/875] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:06:24.348699 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c0237b7a-0c18-408e-88cb-6b5d45f5141e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:24.348699 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c0237b7a-0c18-408e-88cb-6b5d45f5141e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:24.350713 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0237b7a-0c18-408e-88cb-6b5d45f5141e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:24.351041 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0237b7a-0c18-408e-88cb-6b5d45f5141e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:24.351859 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0237b7a-0c18-408e-88cb-6b5d45f5141e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:24.352299 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0237b7a-0c18-408e-88cb-6b5d45f5141e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:24.491934 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c0237b7a-0c18-408e-88cb-6b5d45f5141e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:24.500301 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c0237b7a-0c18-408e-88cb-6b5d45f5141e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1260 microversion: 2.1 time: 0.161918 May 10 20:06:24.501005 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 449/876] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:24 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:25.518131 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f479aec6-ae09-44dc-8817-5c942a7302a4 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:25.518858 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f479aec6-ae09-44dc-8817-5c942a7302a4 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:25.525032 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f479aec6-ae09-44dc-8817-5c942a7302a4 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:25.525481 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f479aec6-ae09-44dc-8817-5c942a7302a4 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:25.526246 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f479aec6-ae09-44dc-8817-5c942a7302a4 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:25.526822 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f479aec6-ae09-44dc-8817-5c942a7302a4 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:25.657535 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f479aec6-ae09-44dc-8817-5c942a7302a4 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:25.664831 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f479aec6-ae09-44dc-8817-5c942a7302a4 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1260 microversion: 2.1 time: 0.151507 May 10 20:06:25.665418 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 428/877] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:25 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:26.681572 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-930ed238-839c-4710-9042-95aea6a20eea tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:26.682220 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-930ed238-839c-4710-9042-95aea6a20eea tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:26.688660 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-930ed238-839c-4710-9042-95aea6a20eea tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:26.689116 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-930ed238-839c-4710-9042-95aea6a20eea tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:26.689884 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-930ed238-839c-4710-9042-95aea6a20eea tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:26.690325 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-930ed238-839c-4710-9042-95aea6a20eea tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:26.818828 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-930ed238-839c-4710-9042-95aea6a20eea tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:26.826143 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-930ed238-839c-4710-9042-95aea6a20eea tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1444 microversion: 2.1 time: 0.148443 May 10 20:06:26.826756 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 450/878] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:26 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:26.842082 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ae470965-b9b9-45f3-b7ed-0c037af11e34 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:26.842751 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ae470965-b9b9-45f3-b7ed-0c037af11e34 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:26.849481 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae470965-b9b9-45f3-b7ed-0c037af11e34 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:26.849931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae470965-b9b9-45f3-b7ed-0c037af11e34 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:26.850737 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae470965-b9b9-45f3-b7ed-0c037af11e34 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:26.851178 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae470965-b9b9-45f3-b7ed-0c037af11e34 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:26.981397 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ae470965-b9b9-45f3-b7ed-0c037af11e34 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:26.989294 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ae470965-b9b9-45f3-b7ed-0c037af11e34 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1444 microversion: 2.1 time: 0.151045 May 10 20:06:26.990125 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 429/879] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:06:26 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:28.754477 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-5b9d0d22-d1c8-4115-8f8a-4b9584bcc9f6 req-2ecde242-7b3f-482b-beb1-1b92b7be5416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee2f0ef-9109-4453-9767-472abca04ffe", "tag": "59264579-f015-4414-9410-630bf057f4aa"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:06:28.762683 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-5b9d0d22-d1c8-4115-8f8a-4b9584bcc9f6 req-2ecde242-7b3f-482b-beb1-1b92b7be5416 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:28.763132 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-5b9d0d22-d1c8-4115-8f8a-4b9584bcc9f6 req-2ecde242-7b3f-482b-beb1-1b92b7be5416 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:28.776487 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-5b9d0d22-d1c8-4115-8f8a-4b9584bcc9f6 req-2ecde242-7b3f-482b-beb1-1b92b7be5416 service nova] Creating event network-changed:59264579-f015-4414-9410-630bf057f4aa for instance 9ee2f0ef-9109-4453-9767-472abca04ffe on hv-cinder-84131 May 10 20:06:28.781652 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-5b9d0d22-d1c8-4115-8f8a-4b9584bcc9f6 req-2ecde242-7b3f-482b-beb1-1b92b7be5416 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030621 May 10 20:06:28.782878 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 451/880] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:06:36.128948 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-902e9b30-4aee-4323-85b4-d1a503dec2ae tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:36.129864 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-902e9b30-4aee-4323-85b4-d1a503dec2ae tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:36.136479 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-902e9b30-4aee-4323-85b4-d1a503dec2ae tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:36.136944 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-902e9b30-4aee-4323-85b4-d1a503dec2ae tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:36.137701 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-902e9b30-4aee-4323-85b4-d1a503dec2ae tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:36.138135 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-902e9b30-4aee-4323-85b4-d1a503dec2ae tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:36.167007 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-902e9b30-4aee-4323-85b4-d1a503dec2ae tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042003 May 10 20:06:36.167876 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 430/881] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 20:06:36 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:06:36.235475 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8fe3724c-3f7e-42fd-beb8-9fda85d2fc9c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:36.236128 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8fe3724c-3f7e-42fd-beb8-9fda85d2fc9c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:36.243254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8fe3724c-3f7e-42fd-beb8-9fda85d2fc9c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:36.243751 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8fe3724c-3f7e-42fd-beb8-9fda85d2fc9c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:36.244615 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8fe3724c-3f7e-42fd-beb8-9fda85d2fc9c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:36.245082 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8fe3724c-3f7e-42fd-beb8-9fda85d2fc9c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:36.428426 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8fe3724c-3f7e-42fd-beb8-9fda85d2fc9c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:06:36.502095 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8fe3724c-3f7e-42fd-beb8-9fda85d2fc9c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "DELETE /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 204 len: 0 microversion: 2.20 time: 0.271606 May 10 20:06:36.502712 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 452/882] 10.222.0.57 () {60 vars in 1279 bytes} [Tue May 10 20:06:36 2022] DELETE /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 20:06:36.511480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c53c3aa1-4441-4c77-8653-029172e6f04b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:36.512097 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c53c3aa1-4441-4c77-8653-029172e6f04b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:36.518402 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c53c3aa1-4441-4c77-8653-029172e6f04b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:36.518889 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c53c3aa1-4441-4c77-8653-029172e6f04b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:36.519656 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c53c3aa1-4441-4c77-8653-029172e6f04b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:36.520092 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c53c3aa1-4441-4c77-8653-029172e6f04b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:36.647830 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c53c3aa1-4441-4c77-8653-029172e6f04b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:36.655512 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c53c3aa1-4441-4c77-8653-029172e6f04b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:36.657042 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c53c3aa1-4441-4c77-8653-029172e6f04b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:36.658197 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c53c3aa1-4441-4c77-8653-029172e6f04b tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.150702 May 10 20:06:36.658803 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 431/883] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:06:36 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:06:37.678447 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-22e8f208-2913-4501-934b-00da6ca6c78e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:37.679110 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-22e8f208-2913-4501-934b-00da6ca6c78e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:37.685406 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-22e8f208-2913-4501-934b-00da6ca6c78e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:37.685855 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-22e8f208-2913-4501-934b-00da6ca6c78e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:37.686654 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-22e8f208-2913-4501-934b-00da6ca6c78e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:37.687086 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-22e8f208-2913-4501-934b-00da6ca6c78e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:37.814084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-22e8f208-2913-4501-934b-00da6ca6c78e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:37.821880 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-22e8f208-2913-4501-934b-00da6ca6c78e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:37.823422 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-22e8f208-2913-4501-934b-00da6ca6c78e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:37.824589 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-22e8f208-2913-4501-934b-00da6ca6c78e tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1723 microversion: 2.20 time: 0.150478 May 10 20:06:37.825143 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 453/884] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:06:37 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:06:38.847738 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-773944f0-25a5-4064-8924-af26e843f030 req-405072f3-d735-4baf-8354-6dd4d90a945c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5", "name": "network-vif-deleted", "tag": "ce79326e-c370-40ae-ba6d-04bd30bc39a2"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:06:38.849193 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2e873cf2-1b2f-4445-a91c-2680fa41dc15 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:38.855021 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2e873cf2-1b2f-4445-a91c-2680fa41dc15 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:38.864599 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e873cf2-1b2f-4445-a91c-2680fa41dc15 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:38.865314 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e873cf2-1b2f-4445-a91c-2680fa41dc15 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:38.866099 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e873cf2-1b2f-4445-a91c-2680fa41dc15 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:38.866635 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e873cf2-1b2f-4445-a91c-2680fa41dc15 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:38.867047 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-773944f0-25a5-4064-8924-af26e843f030 req-405072f3-d735-4baf-8354-6dd4d90a945c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:38.867687 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-773944f0-25a5-4064-8924-af26e843f030 req-405072f3-d735-4baf-8354-6dd4d90a945c service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:38.880795 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-773944f0-25a5-4064-8924-af26e843f030 req-405072f3-d735-4baf-8354-6dd4d90a945c service nova] Creating event network-vif-deleted:ce79326e-c370-40ae-ba6d-04bd30bc39a2 for instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 on hv-cinder-84131 May 10 20:06:38.885872 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-773944f0-25a5-4064-8924-af26e843f030 req-405072f3-d735-4baf-8354-6dd4d90a945c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042231 May 10 20:06:38.889513 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 454/885] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:06:38.939724 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2e873cf2-1b2f-4445-a91c-2680fa41dc15 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:38.949668 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2e873cf2-1b2f-4445-a91c-2680fa41dc15 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:38.951246 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2e873cf2-1b2f-4445-a91c-2680fa41dc15 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56653f5922984dde83b35ba154e97bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7d501f555c4a0ba2419f68ba756db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:06:38.952441 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2e873cf2-1b2f-4445-a91c-2680fa41dc15 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 200 len: 1656 microversion: 2.20 time: 0.113300 May 10 20:06:38.958587 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 432/886] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:06:38 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 1656 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:06:39.973745 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-68232722-94f0-4fb0-9df9-a7d1e0430ace tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:39.974490 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-68232722-94f0-4fb0-9df9-a7d1e0430ace tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:39.980587 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-68232722-94f0-4fb0-9df9-a7d1e0430ace tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:39.981031 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-68232722-94f0-4fb0-9df9-a7d1e0430ace tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:39.981797 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-68232722-94f0-4fb0-9df9-a7d1e0430ace tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:39.982233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-68232722-94f0-4fb0-9df9-a7d1e0430ace tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:39.995225 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-68232722-94f0-4fb0-9df9-a7d1e0430ace tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] HTTP exception thrown: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-68232722-94f0-4fb0-9df9-a7d1e0430ace tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Request method failure captured: May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 HTTP/1.1 May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesSP1BBgKmmoT2a2uWApYh5c83TN5BA9-mhqELVsXpjp1qDc61mPBi07hnriXhtnpSyjp8k0Fe99LpxlaWczMB__yyzsHpzZrNYL0RM05-At2UoVDpEheTar91vc2H2NLHhH5_ZT-JvfXIR9blR8dzy905R69ZmxXEOVnkIjNMoAa_4 May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:06:39.996816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3f7d501f555c4a0ba2419f68ba756db7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3f7d501f555c4a0ba2419f68ba756db7"}]}] May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 56653f5922984dde83b35ba154e97bd0 May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:39.998435 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5'} May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:06:39.999313 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:40.000567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:40.001753 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-68232722-94f0-4fb0-9df9-a7d1e0430ace tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Returning 404 to user: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:06:40.001753 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-68232722-94f0-4fb0-9df9-a7d1e0430ace tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 404 len: 111 microversion: 2.20 time: 0.029807 May 10 20:06:40.001753 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 455/887] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:06:39 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:06:40.007283 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-661f0cae-981f-42c2-bd62-d31b899bb463 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '.version_select at 0x7fdd3988e820>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:40.010569 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-661f0cae-981f-42c2-bd62-d31b899bb463 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [101f1aec-ee48-4197-818c-9639edb51d8d] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 20:06:41.017361 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [None req-661f0cae-981f-42c2-bd62-d31b899bb463 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [101f1aec-ee48-4197-818c-9639edb51d8d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 58630. May 10 20:06:41.036882 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-661f0cae-981f-42c2-bd62-d31b899bb463 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-648228011" status: 204 len: 0 microversion: 2.20 time: 1.033474 May 10 20:06:41.037472 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 433/888] 10.222.0.57 () {60 vars in 1258 bytes} [Tue May 10 20:06:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-648228011 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 20:06:43.002194 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9a8ab679-c6d1-4eef-aab7-5c6d6f9f6b2a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:43.002727 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9a8ab679-c6d1-4eef-aab7-5c6d6f9f6b2a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:43.008931 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9a8ab679-c6d1-4eef-aab7-5c6d6f9f6b2a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:43.009386 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9a8ab679-c6d1-4eef-aab7-5c6d6f9f6b2a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:43.010179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9a8ab679-c6d1-4eef-aab7-5c6d6f9f6b2a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:43.010651 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9a8ab679-c6d1-4eef-aab7-5c6d6f9f6b2a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:43.023972 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-9a8ab679-c6d1-4eef-aab7-5c6d6f9f6b2a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] HTTP exception thrown: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9a8ab679-c6d1-4eef-aab7-5c6d6f9f6b2a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Request method failure captured: May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: DELETE /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 HTTP/1.1 May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesSP1BBgKmmoT2a2uWApYh5c83TN5BA9-mhqELVsXpjp1qDc61mPBi07hnriXhtnpSyjp8k0Fe99LpxlaWczMB__yyzsHpzZrNYL0RM05-At2UoVDpEheTar91vc2H2NLHhH5_ZT-JvfXIR9blR8dzy905R69ZmxXEOVnkIjNMoAa_4 May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:06:43.025501 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3f7d501f555c4a0ba2419f68ba756db7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3f7d501f555c4a0ba2419f68ba756db7"}]}] May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 56653f5922984dde83b35ba154e97bd0 May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:43.027304 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5'} May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:06:43.028179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:43.029452 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:43.030717 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9a8ab679-c6d1-4eef-aab7-5c6d6f9f6b2a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Returning 404 to user: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:06:43.030717 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9a8ab679-c6d1-4eef-aab7-5c6d6f9f6b2a tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "DELETE /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 404 len: 111 microversion: 2.20 time: 0.028609 May 10 20:06:43.030717 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 456/889] 10.222.0.57 () {60 vars in 1279 bytes} [Tue May 10 20:06:42 2022] DELETE /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:06:43.036540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a2e8a06b-8d8f-4a9a-95a8-e8995d57bb3c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:43.037175 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a2e8a06b-8d8f-4a9a-95a8-e8995d57bb3c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:43.043583 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2e8a06b-8d8f-4a9a-95a8-e8995d57bb3c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:43.044036 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2e8a06b-8d8f-4a9a-95a8-e8995d57bb3c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:43.044790 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2e8a06b-8d8f-4a9a-95a8-e8995d57bb3c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:43.045225 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a2e8a06b-8d8f-4a9a-95a8-e8995d57bb3c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:43.058115 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-a2e8a06b-8d8f-4a9a-95a8-e8995d57bb3c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] HTTP exception thrown: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a2e8a06b-8d8f-4a9a-95a8-e8995d57bb3c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Request method failure captured: May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 HTTP/1.1 May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesSP1BBgKmmoT2a2uWApYh5c83TN5BA9-mhqELVsXpjp1qDc61mPBi07hnriXhtnpSyjp8k0Fe99LpxlaWczMB__yyzsHpzZrNYL0RM05-At2UoVDpEheTar91vc2H2NLHhH5_ZT-JvfXIR9blR8dzy905R69ZmxXEOVnkIjNMoAa_4 May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:06:43.059752 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3f7d501f555c4a0ba2419f68ba756db7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3f7d501f555c4a0ba2419f68ba756db7"}]}] May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 56653f5922984dde83b35ba154e97bd0 May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:43.061429 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5'} May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:06:43.062355 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. May 10 20:06:43.063940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:43.065418 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a2e8a06b-8d8f-4a9a-95a8-e8995d57bb3c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Returning 404 to user: Instance 54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:06:43.065418 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a2e8a06b-8d8f-4a9a-95a8-e8995d57bb3c tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5" status: 404 len: 111 microversion: 2.20 time: 0.029667 May 10 20:06:43.065418 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 434/890] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:06:43 2022] GET /compute/v2.1/servers/54b31ba2-8fcc-4e5f-bca7-bc9fbb32b3d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:06:44.198220 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d6cd9628-0920-49ad-acbf-b31137d6da31 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:44.198768 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d6cd9628-0920-49ad-acbf-b31137d6da31 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:44.205709 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d6cd9628-0920-49ad-acbf-b31137d6da31 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:44.206159 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d6cd9628-0920-49ad-acbf-b31137d6da31 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:44.206966 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d6cd9628-0920-49ad-acbf-b31137d6da31 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:44.207403 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d6cd9628-0920-49ad-acbf-b31137d6da31 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:44.220317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-d6cd9628-0920-49ad-acbf-b31137d6da31 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] HTTP exception thrown: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d6cd9628-0920-49ad-acbf-b31137d6da31 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Request method failure captured: May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: DELETE /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 HTTP/1.1 May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesSP1BBgKmmoT2a2uWApYh5c83TN5BA9-mhqELVsXpjp1qDc61mPBi07hnriXhtnpSyjp8k0Fe99LpxlaWczMB__yyzsHpzZrNYL0RM05-At2UoVDpEheTar91vc2H2NLHhH5_ZT-JvfXIR9blR8dzy905R69ZmxXEOVnkIjNMoAa_4 May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:06:44.221848 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3f7d501f555c4a0ba2419f68ba756db7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3f7d501f555c4a0ba2419f68ba756db7"}]}] May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 56653f5922984dde83b35ba154e97bd0 May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:06:44.223556 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': 'ff53e635-0740-4f22-9c5b-8d8dd47571c5'} May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:06:44.224462 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:06:44.226319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:06:44.228139 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d6cd9628-0920-49ad-acbf-b31137d6da31 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Returning 404 to user: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:06:44.228139 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d6cd9628-0920-49ad-acbf-b31137d6da31 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 404 len: 111 microversion: 2.20 time: 0.028925 May 10 20:06:44.228139 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 457/891] 10.222.0.57 () {60 vars in 1279 bytes} [Tue May 10 20:06:44 2022] DELETE /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:06:44.231653 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-152f2195-e778-4db1-97df-6fb1ba43cfe8 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:06:44.232263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-152f2195-e778-4db1-97df-6fb1ba43cfe8 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] [instance: ff53e635-0740-4f22-9c5b-8d8dd47571c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:06:44.239602 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-152f2195-e778-4db1-97df-6fb1ba43cfe8 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:44.240076 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-152f2195-e778-4db1-97df-6fb1ba43cfe8 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:44.241159 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-152f2195-e778-4db1-97df-6fb1ba43cfe8 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:06:44.241547 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-152f2195-e778-4db1-97df-6fb1ba43cfe8 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:06:44.255152 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-152f2195-e778-4db1-97df-6fb1ba43cfe8 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] HTTP exception thrown: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-152f2195-e778-4db1-97df-6fb1ba43cfe8 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Request method failure captured: May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 HTTP/1.1 May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesSP1BBgKmmoT2a2uWApYh5c83TN5BA9-mhqELVsXpjp1qDc61mPBi07hnriXhtnpSyjp8k0Fe99LpxlaWczMB__yyzsHpzZrNYL0RM05-At2UoVDpEheTar91vc2H2NLHhH5_ZT-JvfXIR9blR8dzy905R69ZmxXEOVnkIjNMoAa_4 May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:06:44.256667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3f7d501f555c4a0ba2419f68ba756db7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3f7d501f555c4a0ba2419f68ba756db7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3f7d501f555c4a0ba2419f68ba756db7"}]}] May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: 3f7d501f555c4a0ba2419f68ba756db7 May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1020655112 May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: 56653f5922984dde83b35ba154e97bd0 May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1020655112-project May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:06:44.258348 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': 'ff53e635-0740-4f22-9c5b-8d8dd47571c5'} May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:06:44.259458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. May 10 20:06:44.261018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:06:44.262382 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-152f2195-e778-4db1-97df-6fb1ba43cfe8 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] Returning 404 to user: Instance ff53e635-0740-4f22-9c5b-8d8dd47571c5 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:06:44.262382 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-152f2195-e778-4db1-97df-6fb1ba43cfe8 tempest-AttachVolumeShelveTestJSON-1020655112 tempest-AttachVolumeShelveTestJSON-1020655112-project] 10.222.0.57 "GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5" status: 404 len: 111 microversion: 2.20 time: 0.030293 May 10 20:06:44.262382 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 435/892] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 20:06:44 2022] GET /compute/v2.1/servers/ff53e635-0740-4f22-9c5b-8d8dd47571c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:07:56.864363 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:07:56.865042 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Tue May 10 20:07:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:07:57.003582 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f846fb1b-ad1b-4f41-99ac-c87bbc5cb389 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Action: 'create', calling method: .version_select at 0x7fdd3902e280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-343447002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbJt/OTQ0b1LJS6rIepBtqCvI1tXMBjA7Rx1nRgjHpYkwr5Nly4PwuG9Wk3paPM/Z/nROPbY7+jND5Ndyvhl4Ge6Pmx9GRHpD50L1N3NLmiRR8NpCxLH/2GI14WBJSBQ=="}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:07:57.017591 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-f846fb1b-ad1b-4f41-99ac-c87bbc5cb389 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Getting quotas for project b52def9bc7f1456398c9f2ad21235015. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:07:57.021233 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-f846fb1b-ad1b-4f41-99ac-c87bbc5cb389 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Getting quotas for user e239c11d804746c4a68ded15127755c1 and project b52def9bc7f1456398c9f2ad21235015. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:07:57.047156 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f846fb1b-ad1b-4f41-99ac-c87bbc5cb389 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048343 May 10 20:07:57.047762 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 458/893] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 20:07:56 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:07:57.098727 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-336386194", "imageRef": "8b515c8f-4f36-414e-86a7-007044118edc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-343447002", "networks": [{"uuid": "bced33b1-09af-4f61-b5d3-3f01b6ac9932"}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:07:57.148271 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] validate_networks() for [('bced33b1-09af-4f61-b5d3-3f01b6ac9932', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:07:57.606607 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:07:57.607035 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:07:57.607512 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:07:57.607924 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:07:57.608338 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:07:57.616795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:07:57.617247 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:07:57.618318 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:07:57.618795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:07:57.636845 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Getting quotas for project b52def9bc7f1456398c9f2ad21235015. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:07:57.642237 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Getting quotas for user e239c11d804746c4a68ded15127755c1 and project b52def9bc7f1456398c9f2ad21235015. Resources: {'instances', 'ram', 'cores'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:07:57.653353 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:07:57.655572 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b515c8f-4f36-414e-86a7-007044118edc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:07:57.702988 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a6a309e5-e4d9-44a4-bc94-b8fa781ab26e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608920 May 10 20:07:57.703835 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 436/894] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 20:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:07:57.713497 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c52d3e84-a82d-49c9-b1de-bc45c181272b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:07:57.714220 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c52d3e84-a82d-49c9-b1de-bc45c181272b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:07:57.771476 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c52d3e84-a82d-49c9-b1de-bc45c181272b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:07:57.778544 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c52d3e84-a82d-49c9-b1de-bc45c181272b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1257 microversion: 2.1 time: 0.068448 May 10 20:07:57.779108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 459/895] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:07:57 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:07:58.796206 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8f36427b-c189-45b8-bbe9-ae2e9c369c1e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:07:58.796748 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8f36427b-c189-45b8-bbe9-ae2e9c369c1e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:07:58.803390 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f36427b-c189-45b8-bbe9-ae2e9c369c1e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:07:58.803842 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f36427b-c189-45b8-bbe9-ae2e9c369c1e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:07:58.804783 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f36427b-c189-45b8-bbe9-ae2e9c369c1e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:07:58.805216 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f36427b-c189-45b8-bbe9-ae2e9c369c1e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:07:58.870060 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8f36427b-c189-45b8-bbe9-ae2e9c369c1e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:07:58.877730 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8f36427b-c189-45b8-bbe9-ae2e9c369c1e tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1317 microversion: 2.1 time: 0.086853 May 10 20:07:58.878521 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 437/896] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:07:58 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1317 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:07:59.894685 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-27a3bdb8-fad7-41bc-9df0-f56cff21cafb tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:07:59.895305 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-27a3bdb8-fad7-41bc-9df0-f56cff21cafb tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:07:59.903615 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27a3bdb8-fad7-41bc-9df0-f56cff21cafb tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:07:59.904063 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27a3bdb8-fad7-41bc-9df0-f56cff21cafb tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:07:59.904835 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27a3bdb8-fad7-41bc-9df0-f56cff21cafb tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:07:59.905268 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27a3bdb8-fad7-41bc-9df0-f56cff21cafb tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:00.057710 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-27a3bdb8-fad7-41bc-9df0-f56cff21cafb tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:00.065246 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-27a3bdb8-fad7-41bc-9df0-f56cff21cafb tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.174381 May 10 20:08:00.065824 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 460/897] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:07:59 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:01.083470 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dca46b9e-dcd1-43af-ae83-80753cdf3455 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:01.084087 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dca46b9e-dcd1-43af-ae83-80753cdf3455 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:01.091248 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dca46b9e-dcd1-43af-ae83-80753cdf3455 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:01.091701 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dca46b9e-dcd1-43af-ae83-80753cdf3455 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:01.092483 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dca46b9e-dcd1-43af-ae83-80753cdf3455 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:01.092916 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dca46b9e-dcd1-43af-ae83-80753cdf3455 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:01.397884 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dca46b9e-dcd1-43af-ae83-80753cdf3455 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:01.406028 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dca46b9e-dcd1-43af-ae83-80753cdf3455 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.326403 May 10 20:08:01.406992 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 438/898] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:01 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:02.425184 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-672ff926-f522-4430-a44e-3ce49f31aa83 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:02.426801 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-672ff926-f522-4430-a44e-3ce49f31aa83 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:02.433466 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-672ff926-f522-4430-a44e-3ce49f31aa83 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:02.434566 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-672ff926-f522-4430-a44e-3ce49f31aa83 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:02.435566 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-672ff926-f522-4430-a44e-3ce49f31aa83 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:02.436012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-672ff926-f522-4430-a44e-3ce49f31aa83 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:02.573098 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-672ff926-f522-4430-a44e-3ce49f31aa83 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:02.580621 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-672ff926-f522-4430-a44e-3ce49f31aa83 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.160360 May 10 20:08:02.581529 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 461/899] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:02 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:03.598308 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-90955ff4-3b20-4d04-a502-dfcf3f075917 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:03.599657 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-90955ff4-3b20-4d04-a502-dfcf3f075917 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:03.607018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-90955ff4-3b20-4d04-a502-dfcf3f075917 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:03.607509 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-90955ff4-3b20-4d04-a502-dfcf3f075917 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:03.608332 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-90955ff4-3b20-4d04-a502-dfcf3f075917 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:03.608780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-90955ff4-3b20-4d04-a502-dfcf3f075917 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:03.745795 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-90955ff4-3b20-4d04-a502-dfcf3f075917 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:03.753974 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-90955ff4-3b20-4d04-a502-dfcf3f075917 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.159514 May 10 20:08:03.755150 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 439/900] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:03 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:08:04.771317 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4dc8bc6f-c735-441a-85da-2c0d1b434582 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:04.772268 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4dc8bc6f-c735-441a-85da-2c0d1b434582 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:04.780465 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4dc8bc6f-c735-441a-85da-2c0d1b434582 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:04.781029 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4dc8bc6f-c735-441a-85da-2c0d1b434582 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:04.781895 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4dc8bc6f-c735-441a-85da-2c0d1b434582 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:04.782449 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4dc8bc6f-c735-441a-85da-2c0d1b434582 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:04.916583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4dc8bc6f-c735-441a-85da-2c0d1b434582 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:04.924737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4dc8bc6f-c735-441a-85da-2c0d1b434582 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.157582 May 10 20:08:04.925319 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 462/901] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:04 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:05.941021 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0de56d2d-c8a2-4c83-a8b9-8565b272510b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:05.941662 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0de56d2d-c8a2-4c83-a8b9-8565b272510b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:05.948658 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0de56d2d-c8a2-4c83-a8b9-8565b272510b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:05.949152 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0de56d2d-c8a2-4c83-a8b9-8565b272510b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:05.949937 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0de56d2d-c8a2-4c83-a8b9-8565b272510b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:05.950382 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0de56d2d-c8a2-4c83-a8b9-8565b272510b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:06.086867 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0de56d2d-c8a2-4c83-a8b9-8565b272510b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:06.094749 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0de56d2d-c8a2-4c83-a8b9-8565b272510b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.157505 May 10 20:08:06.095321 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 440/902] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:05 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:07.110939 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-95ae2a9d-a2ec-4803-8d2c-eea74378e0e6 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:07.112213 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-95ae2a9d-a2ec-4803-8d2c-eea74378e0e6 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:07.118821 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95ae2a9d-a2ec-4803-8d2c-eea74378e0e6 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:07.119609 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95ae2a9d-a2ec-4803-8d2c-eea74378e0e6 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:07.120398 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95ae2a9d-a2ec-4803-8d2c-eea74378e0e6 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:07.120837 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95ae2a9d-a2ec-4803-8d2c-eea74378e0e6 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:07.327090 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-95ae2a9d-a2ec-4803-8d2c-eea74378e0e6 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:07.335540 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-95ae2a9d-a2ec-4803-8d2c-eea74378e0e6 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.228153 May 10 20:08:07.336032 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 463/903] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:07 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:07.350673 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-a334df2b-b2c8-4113-bace-9bfe118ceef0 req-5d7f3f9c-9b72-4b2b-b50d-afa04b65f26d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11791c39-5002-4ba0-81ef-4db63be706c5", "tag": "4233280a-c63e-4ca7-a753-38d15f6bc316"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:07.360927 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-a334df2b-b2c8-4113-bace-9bfe118ceef0 req-5d7f3f9c-9b72-4b2b-b50d-afa04b65f26d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:07.361375 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-a334df2b-b2c8-4113-bace-9bfe118ceef0 req-5d7f3f9c-9b72-4b2b-b50d-afa04b65f26d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:07.388960 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-a334df2b-b2c8-4113-bace-9bfe118ceef0 req-5d7f3f9c-9b72-4b2b-b50d-afa04b65f26d service nova] Creating event network-changed:4233280a-c63e-4ca7-a753-38d15f6bc316 for instance 11791c39-5002-4ba0-81ef-4db63be706c5 on hv-cinder-84131 May 10 20:08:07.395017 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-a334df2b-b2c8-4113-bace-9bfe118ceef0 req-5d7f3f9c-9b72-4b2b-b50d-afa04b65f26d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047913 May 10 20:08:07.395862 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 441/904] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:08:08.353153 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b1dfaca0-2eb3-4ed6-b445-6a95a1942a57 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:08.353799 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b1dfaca0-2eb3-4ed6-b445-6a95a1942a57 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:08.360279 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1dfaca0-2eb3-4ed6-b445-6a95a1942a57 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:08.360720 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1dfaca0-2eb3-4ed6-b445-6a95a1942a57 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:08.361478 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1dfaca0-2eb3-4ed6-b445-6a95a1942a57 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:08.361907 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1dfaca0-2eb3-4ed6-b445-6a95a1942a57 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:08.488541 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b1dfaca0-2eb3-4ed6-b445-6a95a1942a57 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:08.496019 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b1dfaca0-2eb3-4ed6-b445-6a95a1942a57 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.146718 May 10 20:08:08.497079 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 464/905] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:08 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:09.514707 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4cdb842a-c5ec-4b37-863d-0da3e52a73ec tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:09.515437 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4cdb842a-c5ec-4b37-863d-0da3e52a73ec tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:09.521676 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4cdb842a-c5ec-4b37-863d-0da3e52a73ec tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:09.522141 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4cdb842a-c5ec-4b37-863d-0da3e52a73ec tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:09.523041 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4cdb842a-c5ec-4b37-863d-0da3e52a73ec tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:09.523491 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4cdb842a-c5ec-4b37-863d-0da3e52a73ec tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:09.655308 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4cdb842a-c5ec-4b37-863d-0da3e52a73ec tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:09.662620 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4cdb842a-c5ec-4b37-863d-0da3e52a73ec tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.153196 May 10 20:08:09.663202 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 442/906] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:09 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:10.680022 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b0cc899e-42c7-4733-b208-28942133ea44 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:10.680632 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b0cc899e-42c7-4733-b208-28942133ea44 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:10.686875 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b0cc899e-42c7-4733-b208-28942133ea44 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:10.687324 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b0cc899e-42c7-4733-b208-28942133ea44 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:10.688079 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b0cc899e-42c7-4733-b208-28942133ea44 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:10.688512 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b0cc899e-42c7-4733-b208-28942133ea44 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:10.817567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b0cc899e-42c7-4733-b208-28942133ea44 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:10.824929 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b0cc899e-42c7-4733-b208-28942133ea44 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.148788 May 10 20:08:10.825593 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 465/907] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:10 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:11.841188 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-49d9abd7-8c2a-41fc-ae58-7d3af24b0f9f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:11.841722 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-49d9abd7-8c2a-41fc-ae58-7d3af24b0f9f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:11.848543 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49d9abd7-8c2a-41fc-ae58-7d3af24b0f9f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:11.848996 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49d9abd7-8c2a-41fc-ae58-7d3af24b0f9f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:11.849764 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49d9abd7-8c2a-41fc-ae58-7d3af24b0f9f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:11.850205 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49d9abd7-8c2a-41fc-ae58-7d3af24b0f9f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:11.975382 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-49d9abd7-8c2a-41fc-ae58-7d3af24b0f9f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:11.982605 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-49d9abd7-8c2a-41fc-ae58-7d3af24b0f9f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.145301 May 10 20:08:11.983173 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 443/908] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:11 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:12.650613 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-a2c94cf2-bf1d-4e5d-9bd3-7a2ffc4744db req-c1037752-7823-47a1-903b-e22e6c3bd942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11791c39-5002-4ba0-81ef-4db63be706c5", "name": "network-vif-plugged", "status": "completed", "tag": "4233280a-c63e-4ca7-a753-38d15f6bc316"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:12.658516 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-a2c94cf2-bf1d-4e5d-9bd3-7a2ffc4744db req-c1037752-7823-47a1-903b-e22e6c3bd942 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:12.658997 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-a2c94cf2-bf1d-4e5d-9bd3-7a2ffc4744db req-c1037752-7823-47a1-903b-e22e6c3bd942 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:12.670793 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-a2c94cf2-bf1d-4e5d-9bd3-7a2ffc4744db req-c1037752-7823-47a1-903b-e22e6c3bd942 service nova] Creating event network-vif-plugged:4233280a-c63e-4ca7-a753-38d15f6bc316 for instance 11791c39-5002-4ba0-81ef-4db63be706c5 on hv-cinder-84131 May 10 20:08:12.676254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-a2c94cf2-bf1d-4e5d-9bd3-7a2ffc4744db req-c1037752-7823-47a1-903b-e22e6c3bd942 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149090 May 10 20:08:12.676882 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 466/909] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:08:13.000085 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-252a317c-94c0-401d-b85a-ccf74a7f047c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:13.000709 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-252a317c-94c0-401d-b85a-ccf74a7f047c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:13.007259 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-252a317c-94c0-401d-b85a-ccf74a7f047c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:13.007722 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-252a317c-94c0-401d-b85a-ccf74a7f047c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:13.008504 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-252a317c-94c0-401d-b85a-ccf74a7f047c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:13.008948 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-252a317c-94c0-401d-b85a-ccf74a7f047c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:13.138680 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-252a317c-94c0-401d-b85a-ccf74a7f047c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:13.147347 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-252a317c-94c0-401d-b85a-ccf74a7f047c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.151705 May 10 20:08:13.147881 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 444/910] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:12 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:14.165749 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4447ea87-62af-4032-9c99-bf29c5844f9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:14.166447 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4447ea87-62af-4032-9c99-bf29c5844f9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:14.172529 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4447ea87-62af-4032-9c99-bf29c5844f9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:14.172983 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4447ea87-62af-4032-9c99-bf29c5844f9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:14.173746 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4447ea87-62af-4032-9c99-bf29c5844f9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:14.174185 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4447ea87-62af-4032-9c99-bf29c5844f9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:14.303976 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4447ea87-62af-4032-9c99-bf29c5844f9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:14.311891 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4447ea87-62af-4032-9c99-bf29c5844f9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1357 microversion: 2.1 time: 0.150805 May 10 20:08:14.312451 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 467/911] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:14 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:15.328996 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5ccc8709-1a18-4a62-bf99-1cf371afa42b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:15.329612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5ccc8709-1a18-4a62-bf99-1cf371afa42b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:15.335903 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ccc8709-1a18-4a62-bf99-1cf371afa42b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:15.336351 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ccc8709-1a18-4a62-bf99-1cf371afa42b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:15.337108 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ccc8709-1a18-4a62-bf99-1cf371afa42b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:15.337547 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5ccc8709-1a18-4a62-bf99-1cf371afa42b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:15.468948 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5ccc8709-1a18-4a62-bf99-1cf371afa42b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:15.476218 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5ccc8709-1a18-4a62-bf99-1cf371afa42b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1548 microversion: 2.1 time: 0.151548 May 10 20:08:15.476780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 445/912] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:15 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:15.492292 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d2221afe-0ed4-42e9-ba28-b35d5c0ccb30 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:15.493441 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d2221afe-0ed4-42e9-ba28-b35d5c0ccb30 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:15.500625 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2221afe-0ed4-42e9-ba28-b35d5c0ccb30 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:15.501088 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2221afe-0ed4-42e9-ba28-b35d5c0ccb30 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:15.501853 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2221afe-0ed4-42e9-ba28-b35d5c0ccb30 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:15.502293 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2221afe-0ed4-42e9-ba28-b35d5c0ccb30 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:15.626673 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d2221afe-0ed4-42e9-ba28-b35d5c0ccb30 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:15.633921 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d2221afe-0ed4-42e9-ba28-b35d5c0ccb30 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1548 microversion: 2.1 time: 0.145413 May 10 20:08:15.634508 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 468/913] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:15 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:15.649281 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6fa9e6e7-ea72-47b2-960b-9d15c87b2488 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:15.652780 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6fa9e6e7-ea72-47b2-960b-9d15c87b2488 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:15.653554 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6fa9e6e7-ea72-47b2-960b-9d15c87b2488 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Searching by: {'deleted': False, 'project_id': 'b52def9bc7f1456398c9f2ad21235015'} {{(pid=117124) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 20:08:15.660616 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6fa9e6e7-ea72-47b2-960b-9d15c87b2488 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:15.661074 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6fa9e6e7-ea72-47b2-960b-9d15c87b2488 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:15.661881 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6fa9e6e7-ea72-47b2-960b-9d15c87b2488 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:15.662323 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6fa9e6e7-ea72-47b2-960b-9d15c87b2488 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:15.756112 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.multi_cell_list [None req-6fa9e6e7-ea72-47b2-960b-9d15c87b2488 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 20:08:15.850354 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6fa9e6e7-ea72-47b2-960b-9d15c87b2488 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204730 May 10 20:08:15.850973 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 446/914] 10.222.0.57 () {58 vars in 1124 bytes} [Tue May 10 20:08:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:08:15.861135 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-696a4b47-f91d-4178-887e-a1f70f6397ba tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:15.861748 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-696a4b47-f91d-4178-887e-a1f70f6397ba tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:15.867565 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-696a4b47-f91d-4178-887e-a1f70f6397ba tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:15.868046 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-696a4b47-f91d-4178-887e-a1f70f6397ba tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:15.869085 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-696a4b47-f91d-4178-887e-a1f70f6397ba tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:15.869525 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-696a4b47-f91d-4178-887e-a1f70f6397ba tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:15.997569 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-696a4b47-f91d-4178-887e-a1f70f6397ba tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:16.005460 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-696a4b47-f91d-4178-887e-a1f70f6397ba tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1548 microversion: 2.1 time: 0.148290 May 10 20:08:16.006037 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 469/915] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:15 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:17.502106 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c74ffb4f-bb8e-4feb-a9be-1f98169301c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df9b1d15-ddba-4237-ba4b-016ccfbbf79f"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:17.503217 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c74ffb4f-bb8e-4feb-a9be-1f98169301c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:17.509416 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c74ffb4f-bb8e-4feb-a9be-1f98169301c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:17.509875 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c74ffb4f-bb8e-4feb-a9be-1f98169301c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:17.510848 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c74ffb4f-bb8e-4feb-a9be-1f98169301c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:17.511294 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c74ffb4f-bb8e-4feb-a9be-1f98169301c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:17.737768 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c74ffb4f-bb8e-4feb-a9be-1f98169301c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "POST /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239637 May 10 20:08:17.738385 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 447/916] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 20:08:17 2022] POST /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:08:25.264134 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b2a185b7-e7b0-413f-9c12-467cabc6b68b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:25.264775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b2a185b7-e7b0-413f-9c12-467cabc6b68b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:25.271012 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2a185b7-e7b0-413f-9c12-467cabc6b68b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:25.271488 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2a185b7-e7b0-413f-9c12-467cabc6b68b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:25.272248 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2a185b7-e7b0-413f-9c12-467cabc6b68b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:25.272680 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2a185b7-e7b0-413f-9c12-467cabc6b68b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:25.634477 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b2a185b7-e7b0-413f-9c12-467cabc6b68b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:25.642664 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b2a185b7-e7b0-413f-9c12-467cabc6b68b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1594 microversion: 2.1 time: 0.382246 May 10 20:08:25.643222 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 470/917] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:25 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1594 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:26.754556 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8e3487fc-3a28-40f6-abed-8cd018dce9c8 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:26.755182 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8e3487fc-3a28-40f6-abed-8cd018dce9c8 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:26.761432 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e3487fc-3a28-40f6-abed-8cd018dce9c8 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:26.761889 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e3487fc-3a28-40f6-abed-8cd018dce9c8 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:26.762697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e3487fc-3a28-40f6-abed-8cd018dce9c8 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:26.763140 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e3487fc-3a28-40f6-abed-8cd018dce9c8 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:26.786859 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-8e3487fc-3a28-40f6-abed-8cd018dce9c8 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lazy-loading 'flavor' on Instance uuid 9ee2f0ef-9109-4453-9767-472abca04ffe {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:08:26.859560 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8e3487fc-3a28-40f6-abed-8cd018dce9c8 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "POST /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe/action" status: 202 len: 0 microversion: 2.1 time: 0.110158 May 10 20:08:26.860441 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 448/918] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 20:08:26 2022] POST /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:08:26.869454 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bc1e75b1-823e-4988-b134-85e66006e827 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:26.870720 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bc1e75b1-823e-4988-b134-85e66006e827 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:26.878147 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc1e75b1-823e-4988-b134-85e66006e827 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:26.878797 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc1e75b1-823e-4988-b134-85e66006e827 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:26.879839 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc1e75b1-823e-4988-b134-85e66006e827 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:26.880363 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc1e75b1-823e-4988-b134-85e66006e827 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:27.101473 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bc1e75b1-823e-4988-b134-85e66006e827 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:27.109018 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bc1e75b1-823e-4988-b134-85e66006e827 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.243881 May 10 20:08:27.109600 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 471/919] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:26 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:27.396394 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-035ef409-fd7f-4a00-b5bf-883557be5472 req-da1f43d9-63f4-4927-9359-84e7c8bd4eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11791c39-5002-4ba0-81ef-4db63be706c5", "tag": "4233280a-c63e-4ca7-a753-38d15f6bc316"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:27.404956 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-035ef409-fd7f-4a00-b5bf-883557be5472 req-da1f43d9-63f4-4927-9359-84e7c8bd4eb9 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:27.405411 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-035ef409-fd7f-4a00-b5bf-883557be5472 req-da1f43d9-63f4-4927-9359-84e7c8bd4eb9 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:27.417456 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-035ef409-fd7f-4a00-b5bf-883557be5472 req-da1f43d9-63f4-4927-9359-84e7c8bd4eb9 service nova] Creating event network-changed:4233280a-c63e-4ca7-a753-38d15f6bc316 for instance 11791c39-5002-4ba0-81ef-4db63be706c5 on hv-cinder-84131 May 10 20:08:27.422702 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-035ef409-fd7f-4a00-b5bf-883557be5472 req-da1f43d9-63f4-4927-9359-84e7c8bd4eb9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031133 May 10 20:08:27.427013 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 449/920] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:08:28.130214 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-92a18008-0c36-4591-9fe8-c20dbe794901 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:28.130998 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-92a18008-0c36-4591-9fe8-c20dbe794901 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:28.138579 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-92a18008-0c36-4591-9fe8-c20dbe794901 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:28.139181 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-92a18008-0c36-4591-9fe8-c20dbe794901 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:28.140076 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-92a18008-0c36-4591-9fe8-c20dbe794901 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:28.140637 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-92a18008-0c36-4591-9fe8-c20dbe794901 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:28.299418 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-92a18008-0c36-4591-9fe8-c20dbe794901 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:28.309367 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-92a18008-0c36-4591-9fe8-c20dbe794901 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.187043 May 10 20:08:28.310103 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 472/921] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:28 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:28.424499 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2302e742-400e-4fc6-8b78-fcd257716b16 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1036356742"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:28.425224 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2302e742-400e-4fc6-8b78-fcd257716b16 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:28.432190 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2302e742-400e-4fc6-8b78-fcd257716b16 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:28.432762 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2302e742-400e-4fc6-8b78-fcd257716b16 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:28.433800 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2302e742-400e-4fc6-8b78-fcd257716b16 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:28.434328 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2302e742-400e-4fc6-8b78-fcd257716b16 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:28.575587 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.network.security_group_api [None req-2302e742-400e-4fc6-8b78-fcd257716b16 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Adding security group 2be18ec3-b62d-4f26-9a9b-c4962bffb696 to port 4233280a-c63e-4ca7-a753-38d15f6bc316 May 10 20:08:28.916526 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2302e742-400e-4fc6-8b78-fcd257716b16 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "POST /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/action" status: 202 len: 0 microversion: 2.1 time: 0.496361 May 10 20:08:28.918003 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 450/922] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 20:08:28 2022] POST /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:08:28.926284 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-48b5bb6e-3068-4e57-92b1-f17032c58a33 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:28.926895 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-48b5bb6e-3068-4e57-92b1-f17032c58a33 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:28.934925 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48b5bb6e-3068-4e57-92b1-f17032c58a33 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:28.935620 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48b5bb6e-3068-4e57-92b1-f17032c58a33 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:28.936576 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48b5bb6e-3068-4e57-92b1-f17032c58a33 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:28.937235 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48b5bb6e-3068-4e57-92b1-f17032c58a33 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:29.064352 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-e74da565-57e1-4b62-8408-ea02fd2ef927 req-e3906357-5739-46e9-ba54-0a0c9162ed24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11791c39-5002-4ba0-81ef-4db63be706c5", "tag": "4233280a-c63e-4ca7-a753-38d15f6bc316"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:29.072638 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-e74da565-57e1-4b62-8408-ea02fd2ef927 req-e3906357-5739-46e9-ba54-0a0c9162ed24 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:29.073188 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-e74da565-57e1-4b62-8408-ea02fd2ef927 req-e3906357-5739-46e9-ba54-0a0c9162ed24 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:29.085571 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-e74da565-57e1-4b62-8408-ea02fd2ef927 req-e3906357-5739-46e9-ba54-0a0c9162ed24 service nova] Creating event network-changed:4233280a-c63e-4ca7-a753-38d15f6bc316 for instance 11791c39-5002-4ba0-81ef-4db63be706c5 on hv-cinder-84131 May 10 20:08:29.092247 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-e74da565-57e1-4b62-8408-ea02fd2ef927 req-e3906357-5739-46e9-ba54-0a0c9162ed24 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168610 May 10 20:08:29.093723 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 473/923] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:08:29.109645 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-48b5bb6e-3068-4e57-92b1-f17032c58a33 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:29.121240 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-48b5bb6e-3068-4e57-92b1-f17032c58a33 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1760 microversion: 2.1 time: 0.199400 May 10 20:08:29.136362 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 451/924] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:28 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1760 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:29.328461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0189cd64-8fea-4043-b0e2-b2967ea3cecf tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:29.330062 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0189cd64-8fea-4043-b0e2-b2967ea3cecf tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:29.336775 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0189cd64-8fea-4043-b0e2-b2967ea3cecf tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:29.337315 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0189cd64-8fea-4043-b0e2-b2967ea3cecf tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:29.338183 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0189cd64-8fea-4043-b0e2-b2967ea3cecf tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:29.338743 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0189cd64-8fea-4043-b0e2-b2967ea3cecf tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:29.560752 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0189cd64-8fea-4043-b0e2-b2967ea3cecf tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:29.571370 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0189cd64-8fea-4043-b0e2-b2967ea3cecf tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.247582 May 10 20:08:29.572709 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 474/925] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:29 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:30.590012 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a9198015-85f0-4aad-a878-8c5815261b94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:30.590664 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a9198015-85f0-4aad-a878-8c5815261b94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:30.597614 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9198015-85f0-4aad-a878-8c5815261b94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:30.598072 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9198015-85f0-4aad-a878-8c5815261b94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:30.598952 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9198015-85f0-4aad-a878-8c5815261b94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:30.599396 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9198015-85f0-4aad-a878-8c5815261b94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:30.726664 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a9198015-85f0-4aad-a878-8c5815261b94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:30.733953 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a9198015-85f0-4aad-a878-8c5815261b94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.147870 May 10 20:08:30.734543 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 452/926] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:30 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:31.750936 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4216c014-edb1-4dd1-970d-0029ea01f391 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:31.751513 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4216c014-edb1-4dd1-970d-0029ea01f391 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:31.757690 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4216c014-edb1-4dd1-970d-0029ea01f391 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:31.758138 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4216c014-edb1-4dd1-970d-0029ea01f391 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:31.758930 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4216c014-edb1-4dd1-970d-0029ea01f391 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:31.759362 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4216c014-edb1-4dd1-970d-0029ea01f391 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:31.886342 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4216c014-edb1-4dd1-970d-0029ea01f391 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:31.893588 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4216c014-edb1-4dd1-970d-0029ea01f391 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.146599 May 10 20:08:31.894150 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 475/927] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:31 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:32.910736 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d3bb0aec-ebbb-4114-9fd1-dcc9e4d83e61 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:32.911277 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d3bb0aec-ebbb-4114-9fd1-dcc9e4d83e61 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:32.917674 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3bb0aec-ebbb-4114-9fd1-dcc9e4d83e61 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:32.918132 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3bb0aec-ebbb-4114-9fd1-dcc9e4d83e61 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:32.918930 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3bb0aec-ebbb-4114-9fd1-dcc9e4d83e61 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:32.919374 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3bb0aec-ebbb-4114-9fd1-dcc9e4d83e61 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:33.047964 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d3bb0aec-ebbb-4114-9fd1-dcc9e4d83e61 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:33.056123 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d3bb0aec-ebbb-4114-9fd1-dcc9e4d83e61 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.149368 May 10 20:08:33.056702 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 453/928] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:32 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:34.074008 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4707c7df-cf3a-44dd-8ea8-261a5441cb96 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:34.074657 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4707c7df-cf3a-44dd-8ea8-261a5441cb96 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:34.081284 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4707c7df-cf3a-44dd-8ea8-261a5441cb96 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:34.081743 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4707c7df-cf3a-44dd-8ea8-261a5441cb96 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:34.082567 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4707c7df-cf3a-44dd-8ea8-261a5441cb96 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:34.083014 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4707c7df-cf3a-44dd-8ea8-261a5441cb96 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:34.211461 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4707c7df-cf3a-44dd-8ea8-261a5441cb96 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:34.218782 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4707c7df-cf3a-44dd-8ea8-261a5441cb96 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.148598 May 10 20:08:34.219391 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 476/929] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:34 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:35.236398 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-70f63e35-ae68-44fe-ada9-49917b9f996b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:35.237060 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-70f63e35-ae68-44fe-ada9-49917b9f996b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:35.243388 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-70f63e35-ae68-44fe-ada9-49917b9f996b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:35.243864 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-70f63e35-ae68-44fe-ada9-49917b9f996b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:35.244887 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-70f63e35-ae68-44fe-ada9-49917b9f996b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:35.245329 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-70f63e35-ae68-44fe-ada9-49917b9f996b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:35.375888 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-70f63e35-ae68-44fe-ada9-49917b9f996b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:35.383706 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-70f63e35-ae68-44fe-ada9-49917b9f996b tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.151216 May 10 20:08:35.384272 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 454/930] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:35 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:36.401311 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b555cf57-a8ac-437b-8792-cc8bbdf91c68 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:36.401928 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b555cf57-a8ac-437b-8792-cc8bbdf91c68 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:36.408429 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b555cf57-a8ac-437b-8792-cc8bbdf91c68 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:36.408895 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b555cf57-a8ac-437b-8792-cc8bbdf91c68 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:36.409663 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b555cf57-a8ac-437b-8792-cc8bbdf91c68 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:36.410104 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b555cf57-a8ac-437b-8792-cc8bbdf91c68 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:36.538695 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b555cf57-a8ac-437b-8792-cc8bbdf91c68 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:36.545940 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b555cf57-a8ac-437b-8792-cc8bbdf91c68 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.148560 May 10 20:08:36.546531 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 477/931] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:36 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:37.563612 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cfa91c3e-0191-447e-bdbd-66e37b7baacc tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:37.564852 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cfa91c3e-0191-447e-bdbd-66e37b7baacc tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:37.571217 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cfa91c3e-0191-447e-bdbd-66e37b7baacc tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:37.571673 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cfa91c3e-0191-447e-bdbd-66e37b7baacc tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:37.572436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cfa91c3e-0191-447e-bdbd-66e37b7baacc tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:37.572870 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cfa91c3e-0191-447e-bdbd-66e37b7baacc tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:37.699893 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cfa91c3e-0191-447e-bdbd-66e37b7baacc tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:37.707235 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cfa91c3e-0191-447e-bdbd-66e37b7baacc tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.147501 May 10 20:08:37.707802 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 455/932] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:37 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:38.723921 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-668dea32-a769-438f-9e01-95930d3694b7 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:38.725283 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-668dea32-a769-438f-9e01-95930d3694b7 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:38.731711 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-668dea32-a769-438f-9e01-95930d3694b7 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:38.732172 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-668dea32-a769-438f-9e01-95930d3694b7 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:38.732946 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-668dea32-a769-438f-9e01-95930d3694b7 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:38.733389 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-668dea32-a769-438f-9e01-95930d3694b7 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:38.871297 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-668dea32-a769-438f-9e01-95930d3694b7 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:38.879236 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-668dea32-a769-438f-9e01-95930d3694b7 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.159230 May 10 20:08:38.880008 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 478/933] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:38 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:39.897002 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d44c93af-3ded-4259-bae9-ecbfe72c7ea6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:39.897565 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d44c93af-3ded-4259-bae9-ecbfe72c7ea6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:39.903820 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d44c93af-3ded-4259-bae9-ecbfe72c7ea6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:39.904284 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d44c93af-3ded-4259-bae9-ecbfe72c7ea6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:39.905059 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d44c93af-3ded-4259-bae9-ecbfe72c7ea6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:39.905506 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d44c93af-3ded-4259-bae9-ecbfe72c7ea6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:40.042818 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d44c93af-3ded-4259-bae9-ecbfe72c7ea6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:40.050195 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d44c93af-3ded-4259-bae9-ecbfe72c7ea6 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1570 microversion: 2.1 time: 0.157741 May 10 20:08:40.050800 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 456/934] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:39 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:40.066965 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6567a8eb-68fe-4591-9875-9450b5e6263e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:40.067534 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6567a8eb-68fe-4591-9875-9450b5e6263e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:40.073601 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6567a8eb-68fe-4591-9875-9450b5e6263e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:40.074053 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6567a8eb-68fe-4591-9875-9450b5e6263e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:40.074842 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6567a8eb-68fe-4591-9875-9450b5e6263e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:40.075277 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6567a8eb-68fe-4591-9875-9450b5e6263e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:40.149038 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6567a8eb-68fe-4591-9875-9450b5e6263e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "POST /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe/action" status: 202 len: 0 microversion: 2.1 time: 0.086337 May 10 20:08:40.149564 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 479/935] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 20:08:40 2022] POST /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:08:40.157687 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2e6047b1-e59d-4ad3-b0dc-2530a305e7e0 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:40.158309 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2e6047b1-e59d-4ad3-b0dc-2530a305e7e0 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:40.164223 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e6047b1-e59d-4ad3-b0dc-2530a305e7e0 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:40.164685 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e6047b1-e59d-4ad3-b0dc-2530a305e7e0 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:40.165462 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e6047b1-e59d-4ad3-b0dc-2530a305e7e0 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:40.165906 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e6047b1-e59d-4ad3-b0dc-2530a305e7e0 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:40.302778 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2e6047b1-e59d-4ad3-b0dc-2530a305e7e0 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:40.310448 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2e6047b1-e59d-4ad3-b0dc-2530a305e7e0 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1518 microversion: 2.1 time: 0.156611 May 10 20:08:40.311048 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 457/936] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:40 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:41.328368 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-af8cd885-5709-472e-88a7-a44c511b20ec tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:41.328987 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-af8cd885-5709-472e-88a7-a44c511b20ec tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:41.336350 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-af8cd885-5709-472e-88a7-a44c511b20ec tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:41.336790 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-af8cd885-5709-472e-88a7-a44c511b20ec tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:41.337565 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-af8cd885-5709-472e-88a7-a44c511b20ec tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:41.338001 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-af8cd885-5709-472e-88a7-a44c511b20ec tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:41.471013 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-af8cd885-5709-472e-88a7-a44c511b20ec tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:41.478591 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-af8cd885-5709-472e-88a7-a44c511b20ec tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1520 microversion: 2.1 time: 0.154030 May 10 20:08:41.479163 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 480/937] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:41 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:42.495716 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-118ed42a-1f5a-4f52-b6fc-079843d6ad54 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:42.496356 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-118ed42a-1f5a-4f52-b6fc-079843d6ad54 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:42.502565 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-118ed42a-1f5a-4f52-b6fc-079843d6ad54 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:42.503017 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-118ed42a-1f5a-4f52-b6fc-079843d6ad54 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:42.503778 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-118ed42a-1f5a-4f52-b6fc-079843d6ad54 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:42.504367 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-118ed42a-1f5a-4f52-b6fc-079843d6ad54 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:42.577904 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-f3017d5c-8086-476b-9276-c03fef60bfd3 req-c6268124-9456-48f6-b379-232f4e5c3ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee2f0ef-9109-4453-9767-472abca04ffe", "name": "network-vif-unplugged", "status": "completed", "tag": "59264579-f015-4414-9410-630bf057f4aa"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:42.591898 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-f3017d5c-8086-476b-9276-c03fef60bfd3 req-c6268124-9456-48f6-b379-232f4e5c3ffe service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:42.592511 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-f3017d5c-8086-476b-9276-c03fef60bfd3 req-c6268124-9456-48f6-b379-232f4e5c3ffe service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:42.604430 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-f3017d5c-8086-476b-9276-c03fef60bfd3 req-c6268124-9456-48f6-b379-232f4e5c3ffe service nova] Creating event network-vif-unplugged:59264579-f015-4414-9410-630bf057f4aa for instance 9ee2f0ef-9109-4453-9767-472abca04ffe on hv-cinder-84131 May 10 20:08:42.609477 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-f3017d5c-8086-476b-9276-c03fef60bfd3 req-c6268124-9456-48f6-b379-232f4e5c3ffe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035329 May 10 20:08:42.610381 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 481/938] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:08:42.643136 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-118ed42a-1f5a-4f52-b6fc-079843d6ad54 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:42.651730 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-118ed42a-1f5a-4f52-b6fc-079843d6ad54 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1576 microversion: 2.1 time: 0.160107 May 10 20:08:42.652325 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 458/939] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:42 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:43.670020 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6514f848-94a1-4918-a992-be5f56757067 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:43.670770 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6514f848-94a1-4918-a992-be5f56757067 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:43.677596 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6514f848-94a1-4918-a992-be5f56757067 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:43.678049 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6514f848-94a1-4918-a992-be5f56757067 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:43.678838 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6514f848-94a1-4918-a992-be5f56757067 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:43.679273 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6514f848-94a1-4918-a992-be5f56757067 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:43.805365 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6514f848-94a1-4918-a992-be5f56757067 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:43.812692 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6514f848-94a1-4918-a992-be5f56757067 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1576 microversion: 2.1 time: 0.147344 May 10 20:08:43.813254 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 482/940] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:43 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:44.829687 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ea33ec4a-b285-4b3b-a00c-cd7fe934f95d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:44.830263 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ea33ec4a-b285-4b3b-a00c-cd7fe934f95d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:44.836645 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea33ec4a-b285-4b3b-a00c-cd7fe934f95d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:44.837103 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea33ec4a-b285-4b3b-a00c-cd7fe934f95d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:44.837873 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea33ec4a-b285-4b3b-a00c-cd7fe934f95d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:44.838317 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea33ec4a-b285-4b3b-a00c-cd7fe934f95d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:44.968512 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ea33ec4a-b285-4b3b-a00c-cd7fe934f95d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:44.975804 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ea33ec4a-b285-4b3b-a00c-cd7fe934f95d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1576 microversion: 2.1 time: 0.150059 May 10 20:08:44.976379 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 459/941] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:44 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:45.993446 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-64a1e600-8ee4-4820-8cfb-0d23e897eb26 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:45.994065 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-64a1e600-8ee4-4820-8cfb-0d23e897eb26 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:46.000752 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-64a1e600-8ee4-4820-8cfb-0d23e897eb26 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:46.001205 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-64a1e600-8ee4-4820-8cfb-0d23e897eb26 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:46.001980 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-64a1e600-8ee4-4820-8cfb-0d23e897eb26 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:46.002419 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-64a1e600-8ee4-4820-8cfb-0d23e897eb26 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:46.130957 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-64a1e600-8ee4-4820-8cfb-0d23e897eb26 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:46.138219 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-64a1e600-8ee4-4820-8cfb-0d23e897eb26 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1576 microversion: 2.1 time: 0.148777 May 10 20:08:46.138838 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 483/942] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:45 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:47.156334 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-be9b2ed1-2784-4a4a-ab95-e6f20e064492 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:47.156951 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-be9b2ed1-2784-4a4a-ab95-e6f20e064492 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:47.163946 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-be9b2ed1-2784-4a4a-ab95-e6f20e064492 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:47.164394 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-be9b2ed1-2784-4a4a-ab95-e6f20e064492 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:47.165158 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-be9b2ed1-2784-4a4a-ab95-e6f20e064492 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:47.165595 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-be9b2ed1-2784-4a4a-ab95-e6f20e064492 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:47.293069 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-be9b2ed1-2784-4a4a-ab95-e6f20e064492 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:47.300610 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-be9b2ed1-2784-4a4a-ab95-e6f20e064492 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1576 microversion: 2.1 time: 0.148132 May 10 20:08:47.301177 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 460/943] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:47 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:48.316956 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3419b7b1-dc33-4e2b-af3a-99631c7e5d04 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:48.317569 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3419b7b1-dc33-4e2b-af3a-99631c7e5d04 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:48.323876 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3419b7b1-dc33-4e2b-af3a-99631c7e5d04 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:48.324355 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3419b7b1-dc33-4e2b-af3a-99631c7e5d04 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:48.325126 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3419b7b1-dc33-4e2b-af3a-99631c7e5d04 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:48.325564 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3419b7b1-dc33-4e2b-af3a-99631c7e5d04 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:48.456162 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3419b7b1-dc33-4e2b-af3a-99631c7e5d04 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:48.464201 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3419b7b1-dc33-4e2b-af3a-99631c7e5d04 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1576 microversion: 2.1 time: 0.151057 May 10 20:08:48.464975 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 484/944] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:48 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:49.481745 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-caf9cc9d-2ca3-4d84-ad29-36671648465c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:49.482199 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-caf9cc9d-2ca3-4d84-ad29-36671648465c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:49.489171 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-caf9cc9d-2ca3-4d84-ad29-36671648465c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:49.489621 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-caf9cc9d-2ca3-4d84-ad29-36671648465c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:49.490386 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-caf9cc9d-2ca3-4d84-ad29-36671648465c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:49.490849 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-caf9cc9d-2ca3-4d84-ad29-36671648465c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:49.617801 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-caf9cc9d-2ca3-4d84-ad29-36671648465c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:49.625401 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-caf9cc9d-2ca3-4d84-ad29-36671648465c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1576 microversion: 2.1 time: 0.147630 May 10 20:08:49.625978 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 461/945] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:49 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:50.642332 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fbad5eb1-8d59-41f0-a37b-ddfb8a3a3a0c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:50.643240 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fbad5eb1-8d59-41f0-a37b-ddfb8a3a3a0c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:50.650404 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fbad5eb1-8d59-41f0-a37b-ddfb8a3a3a0c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:50.650958 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fbad5eb1-8d59-41f0-a37b-ddfb8a3a3a0c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:50.651842 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fbad5eb1-8d59-41f0-a37b-ddfb8a3a3a0c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:50.652305 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fbad5eb1-8d59-41f0-a37b-ddfb8a3a3a0c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:50.781809 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fbad5eb1-8d59-41f0-a37b-ddfb8a3a3a0c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:50.791037 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fbad5eb1-8d59-41f0-a37b-ddfb8a3a3a0c tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1563 microversion: 2.1 time: 0.152507 May 10 20:08:50.792068 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 485/946] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:50 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:51.667524 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ba3c0bd5-4752-4071-9083-7b42683cb742 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:51.668558 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ba3c0bd5-4752-4071-9083-7b42683cb742 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:51.674975 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ba3c0bd5-4752-4071-9083-7b42683cb742 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:51.675981 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ba3c0bd5-4752-4071-9083-7b42683cb742 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:51.676760 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ba3c0bd5-4752-4071-9083-7b42683cb742 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:51.677205 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ba3c0bd5-4752-4071-9083-7b42683cb742 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:51.750157 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ba3c0bd5-4752-4071-9083-7b42683cb742 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "POST /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/action" status: 202 len: 0 microversion: 2.1 time: 0.086328 May 10 20:08:51.750846 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 462/947] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 20:08:51 2022] POST /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:08:51.759522 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ed9c827f-42c2-4479-b500-221896a3cda3 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:51.760178 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ed9c827f-42c2-4479-b500-221896a3cda3 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:51.767105 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ed9c827f-42c2-4479-b500-221896a3cda3 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:51.767590 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ed9c827f-42c2-4479-b500-221896a3cda3 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:51.768481 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ed9c827f-42c2-4479-b500-221896a3cda3 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:51.769056 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ed9c827f-42c2-4479-b500-221896a3cda3 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:51.993818 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ed9c827f-42c2-4479-b500-221896a3cda3 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:52.001814 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ed9c827f-42c2-4479-b500-221896a3cda3 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1752 microversion: 2.1 time: 0.246103 May 10 20:08:52.002324 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 486/948] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:51 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1752 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:52.637229 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-4f1b5189-5e84-41e7-8d82-377acb4b04b2 req-9f4d6521-09d8-47a8-bd4c-9028b5ecc370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee2f0ef-9109-4453-9767-472abca04ffe", "name": "network-vif-plugged", "status": "completed", "tag": "59264579-f015-4414-9410-630bf057f4aa"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:08:52.645750 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4f1b5189-5e84-41e7-8d82-377acb4b04b2 req-9f4d6521-09d8-47a8-bd4c-9028b5ecc370 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:52.646206 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4f1b5189-5e84-41e7-8d82-377acb4b04b2 req-9f4d6521-09d8-47a8-bd4c-9028b5ecc370 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:52.658384 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-4f1b5189-5e84-41e7-8d82-377acb4b04b2 req-9f4d6521-09d8-47a8-bd4c-9028b5ecc370 service nova] Creating event network-vif-plugged:59264579-f015-4414-9410-630bf057f4aa for instance 9ee2f0ef-9109-4453-9767-472abca04ffe on hv-cinder-84131 May 10 20:08:52.663764 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-4f1b5189-5e84-41e7-8d82-377acb4b04b2 req-9f4d6521-09d8-47a8-bd4c-9028b5ecc370 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030667 May 10 20:08:52.664545 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 463/949] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:08:53.020282 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c246ed72-1b60-4bf3-bdb5-4c978e544a9d tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:53.020900 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c246ed72-1b60-4bf3-bdb5-4c978e544a9d tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:53.027361 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c246ed72-1b60-4bf3-bdb5-4c978e544a9d tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:53.027823 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c246ed72-1b60-4bf3-bdb5-4c978e544a9d tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:53.028595 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c246ed72-1b60-4bf3-bdb5-4c978e544a9d tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:53.029030 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c246ed72-1b60-4bf3-bdb5-4c978e544a9d tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:53.173385 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c246ed72-1b60-4bf3-bdb5-4c978e544a9d tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:53.181759 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c246ed72-1b60-4bf3-bdb5-4c978e544a9d tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1757 microversion: 2.1 time: 0.165879 May 10 20:08:53.182324 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 487/950] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:53 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:54.199984 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1084c69e-38ea-43c5-89c5-5ab79fd69d9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:54.200693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1084c69e-38ea-43c5-89c5-5ab79fd69d9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:54.207084 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1084c69e-38ea-43c5-89c5-5ab79fd69d9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:54.207815 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1084c69e-38ea-43c5-89c5-5ab79fd69d9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:54.208919 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1084c69e-38ea-43c5-89c5-5ab79fd69d9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:54.209366 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1084c69e-38ea-43c5-89c5-5ab79fd69d9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:54.353730 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1084c69e-38ea-43c5-89c5-5ab79fd69d9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:54.361659 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1084c69e-38ea-43c5-89c5-5ab79fd69d9c tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1757 microversion: 2.1 time: 0.166278 May 10 20:08:54.362224 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 464/951] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:54 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:55.379517 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-38bea993-a2bc-4488-b9dd-780f9622a2e1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:55.380161 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-38bea993-a2bc-4488-b9dd-780f9622a2e1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:55.386433 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38bea993-a2bc-4488-b9dd-780f9622a2e1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:55.386920 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38bea993-a2bc-4488-b9dd-780f9622a2e1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:55.387693 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38bea993-a2bc-4488-b9dd-780f9622a2e1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:55.388134 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38bea993-a2bc-4488-b9dd-780f9622a2e1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:55.526202 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-38bea993-a2bc-4488-b9dd-780f9622a2e1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:55.534193 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-38bea993-a2bc-4488-b9dd-780f9622a2e1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1757 microversion: 2.1 time: 0.159064 May 10 20:08:55.534737 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 488/952] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:55 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:56.551386 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4a776de9-f9e7-4ddf-a288-1f1ff79d5dfa tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:56.552006 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4a776de9-f9e7-4ddf-a288-1f1ff79d5dfa tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:56.557950 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4a776de9-f9e7-4ddf-a288-1f1ff79d5dfa tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:56.558410 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4a776de9-f9e7-4ddf-a288-1f1ff79d5dfa tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:56.559211 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4a776de9-f9e7-4ddf-a288-1f1ff79d5dfa tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:56.559660 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4a776de9-f9e7-4ddf-a288-1f1ff79d5dfa tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:56.696811 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4a776de9-f9e7-4ddf-a288-1f1ff79d5dfa tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:56.705049 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4a776de9-f9e7-4ddf-a288-1f1ff79d5dfa tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1757 microversion: 2.1 time: 0.157690 May 10 20:08:56.713209 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 465/953] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:56 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:57.723389 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-03ba3fa3-77f6-413d-9305-51c4225d68ee tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:57.724043 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-03ba3fa3-77f6-413d-9305-51c4225d68ee tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:57.730367 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-03ba3fa3-77f6-413d-9305-51c4225d68ee tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:57.730861 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-03ba3fa3-77f6-413d-9305-51c4225d68ee tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:57.731638 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-03ba3fa3-77f6-413d-9305-51c4225d68ee tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:57.732080 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-03ba3fa3-77f6-413d-9305-51c4225d68ee tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:57.868215 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-03ba3fa3-77f6-413d-9305-51c4225d68ee tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:57.876134 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-03ba3fa3-77f6-413d-9305-51c4225d68ee tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1757 microversion: 2.1 time: 0.157269 May 10 20:08:57.876703 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 489/954] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:57 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1757 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:08:58.894912 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ff0d214d-1220-4c13-8d55-d919e6c41da5 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:08:58.895480 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ff0d214d-1220-4c13-8d55-d919e6c41da5 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:08:58.901762 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff0d214d-1220-4c13-8d55-d919e6c41da5 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:58.902219 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff0d214d-1220-4c13-8d55-d919e6c41da5 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:58.903012 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff0d214d-1220-4c13-8d55-d919e6c41da5 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:08:58.903455 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff0d214d-1220-4c13-8d55-d919e6c41da5 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:08:59.046158 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ff0d214d-1220-4c13-8d55-d919e6c41da5 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:08:59.054540 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ff0d214d-1220-4c13-8d55-d919e6c41da5 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1757 microversion: 2.1 time: 0.164128 May 10 20:08:59.055123 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 466/955] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:08:58 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:00.071470 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-06fa2f0d-2b26-419e-94cf-dcd65674ee8b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:00.072092 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-06fa2f0d-2b26-419e-94cf-dcd65674ee8b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:00.078398 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-06fa2f0d-2b26-419e-94cf-dcd65674ee8b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:00.078889 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-06fa2f0d-2b26-419e-94cf-dcd65674ee8b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:00.079659 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-06fa2f0d-2b26-419e-94cf-dcd65674ee8b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:00.080100 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-06fa2f0d-2b26-419e-94cf-dcd65674ee8b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:00.222075 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-06fa2f0d-2b26-419e-94cf-dcd65674ee8b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:09:00.229839 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-06fa2f0d-2b26-419e-94cf-dcd65674ee8b tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1757 microversion: 2.1 time: 0.162232 May 10 20:09:00.230437 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 490/956] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:09:00 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:01.246992 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ec570487-40c3-447c-8756-708b71ee18c1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:01.247610 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ec570487-40c3-447c-8756-708b71ee18c1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:01.254532 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec570487-40c3-447c-8756-708b71ee18c1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:01.254993 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec570487-40c3-447c-8756-708b71ee18c1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:01.255763 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec570487-40c3-447c-8756-708b71ee18c1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:01.256210 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec570487-40c3-447c-8756-708b71ee18c1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:01.394931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ec570487-40c3-447c-8756-708b71ee18c1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:09:01.402673 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ec570487-40c3-447c-8756-708b71ee18c1 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1757 microversion: 2.1 time: 0.159775 May 10 20:09:01.403245 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 467/957] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:09:01 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:02.419532 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-33188979-bf6e-42cc-ab45-ecb71dde74cf tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:02.420214 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-33188979-bf6e-42cc-ab45-ecb71dde74cf tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:02.426649 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-33188979-bf6e-42cc-ab45-ecb71dde74cf tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:02.427108 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-33188979-bf6e-42cc-ab45-ecb71dde74cf tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:02.427878 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-33188979-bf6e-42cc-ab45-ecb71dde74cf tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:02.428321 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-33188979-bf6e-42cc-ab45-ecb71dde74cf tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:02.567180 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-33188979-bf6e-42cc-ab45-ecb71dde74cf tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:09:02.575018 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-33188979-bf6e-42cc-ab45-ecb71dde74cf tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1757 microversion: 2.1 time: 0.159321 May 10 20:09:02.575589 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 491/958] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:09:02 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:03.591517 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8196fb1e-0faa-4a74-9306-2678740b4906 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:03.592125 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8196fb1e-0faa-4a74-9306-2678740b4906 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:03.598524 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8196fb1e-0faa-4a74-9306-2678740b4906 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:03.598976 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8196fb1e-0faa-4a74-9306-2678740b4906 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:03.599732 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8196fb1e-0faa-4a74-9306-2678740b4906 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:03.600164 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8196fb1e-0faa-4a74-9306-2678740b4906 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:03.740817 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8196fb1e-0faa-4a74-9306-2678740b4906 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:09:03.749000 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8196fb1e-0faa-4a74-9306-2678740b4906 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1757 microversion: 2.1 time: 0.161315 May 10 20:09:03.749591 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 468/959] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:09:03 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:04.766565 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-81892a52-2b65-464b-acc1-354099075306 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:04.767188 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-81892a52-2b65-464b-acc1-354099075306 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:04.774321 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81892a52-2b65-464b-acc1-354099075306 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:04.774812 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81892a52-2b65-464b-acc1-354099075306 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:04.775583 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81892a52-2b65-464b-acc1-354099075306 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:04.776057 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-81892a52-2b65-464b-acc1-354099075306 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:04.915515 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-81892a52-2b65-464b-acc1-354099075306 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:09:04.923351 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-81892a52-2b65-464b-acc1-354099075306 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1760 microversion: 2.1 time: 0.160713 May 10 20:09:04.923913 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 492/960] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:09:04 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1760 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:38.267068 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9846ef72-8651-41f6-8903-69d2e47591c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1036356742"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:38.267694 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9846ef72-8651-41f6-8903-69d2e47591c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:38.273742 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9846ef72-8651-41f6-8903-69d2e47591c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:38.274192 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9846ef72-8651-41f6-8903-69d2e47591c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:38.274987 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9846ef72-8651-41f6-8903-69d2e47591c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:38.275437 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9846ef72-8651-41f6-8903-69d2e47591c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:38.398079 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.network.security_group_api [None req-9846ef72-8651-41f6-8903-69d2e47591c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Removing security group 2be18ec3-b62d-4f26-9a9b-c4962bffb696 from port 4233280a-c63e-4ca7-a753-38d15f6bc316 May 10 20:09:38.724785 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9846ef72-8651-41f6-8903-69d2e47591c0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "POST /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/action" status: 202 len: 0 microversion: 2.1 time: 0.461644 May 10 20:09:38.725701 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 469/961] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 20:09:38 2022] POST /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:09:38.734161 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-2e28ec9b-4206-4ff8-892e-3cc93c2d8954 req-4f0af695-fb00-4f73-9635-d0b6e365b912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11791c39-5002-4ba0-81ef-4db63be706c5", "tag": "4233280a-c63e-4ca7-a753-38d15f6bc316"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:38.748803 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-2e28ec9b-4206-4ff8-892e-3cc93c2d8954 req-4f0af695-fb00-4f73-9635-d0b6e365b912 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:38.749265 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-2e28ec9b-4206-4ff8-892e-3cc93c2d8954 req-4f0af695-fb00-4f73-9635-d0b6e365b912 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:38.776105 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-2e28ec9b-4206-4ff8-892e-3cc93c2d8954 req-4f0af695-fb00-4f73-9635-d0b6e365b912 service nova] Creating event network-changed:4233280a-c63e-4ca7-a753-38d15f6bc316 for instance 11791c39-5002-4ba0-81ef-4db63be706c5 on hv-cinder-84131 May 10 20:09:38.791816 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-2e28ec9b-4206-4ff8-892e-3cc93c2d8954 req-4f0af695-fb00-4f73-9635-d0b6e365b912 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060181 May 10 20:09:38.797155 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 493/962] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:39.907154 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a0e0824f-0bc2-4b4f-bd30-87c988d9e817 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:39.907767 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a0e0824f-0bc2-4b4f-bd30-87c988d9e817 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:39.913769 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a0e0824f-0bc2-4b4f-bd30-87c988d9e817 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:39.914300 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a0e0824f-0bc2-4b4f-bd30-87c988d9e817 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:39.915111 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a0e0824f-0bc2-4b4f-bd30-87c988d9e817 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:39.915557 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a0e0824f-0bc2-4b4f-bd30-87c988d9e817 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:39.994693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-a0e0824f-0bc2-4b4f-bd30-87c988d9e817 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lazy-loading 'services' on Instance uuid 11791c39-5002-4ba0-81ef-4db63be706c5 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:09:40.069743 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a0e0824f-0bc2-4b4f-bd30-87c988d9e817 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "DELETE /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/os-volume_attachments/df9b1d15-ddba-4237-ba4b-016ccfbbf79f" status: 202 len: 0 microversion: 2.1 time: 0.167307 May 10 20:09:40.070452 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 470/963] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 20:09:39 2022] DELETE /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/os-volume_attachments/df9b1d15-ddba-4237-ba4b-016ccfbbf79f => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:09:40.081524 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-17c52ccd-860e-44c5-a8ca-99b002a03ba9 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:40.082746 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-17c52ccd-860e-44c5-a8ca-99b002a03ba9 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:40.089499 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17c52ccd-860e-44c5-a8ca-99b002a03ba9 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:40.089983 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17c52ccd-860e-44c5-a8ca-99b002a03ba9 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:40.091021 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17c52ccd-860e-44c5-a8ca-99b002a03ba9 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:40.091611 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17c52ccd-860e-44c5-a8ca-99b002a03ba9 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:40.125846 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-17c52ccd-860e-44c5-a8ca-99b002a03ba9 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049971 May 10 20:09:40.126725 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 494/964] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:09:40 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:40.808157 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-b61deb0f-6f2b-4329-97d2-0b62d7e7b9da req-669a6890-4279-4209-9cf4-8fd6af602dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11791c39-5002-4ba0-81ef-4db63be706c5", "tag": "4233280a-c63e-4ca7-a753-38d15f6bc316"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:40.816675 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-b61deb0f-6f2b-4329-97d2-0b62d7e7b9da req-669a6890-4279-4209-9cf4-8fd6af602dc1 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:40.817128 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-b61deb0f-6f2b-4329-97d2-0b62d7e7b9da req-669a6890-4279-4209-9cf4-8fd6af602dc1 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:40.828809 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-b61deb0f-6f2b-4329-97d2-0b62d7e7b9da req-669a6890-4279-4209-9cf4-8fd6af602dc1 service nova] Creating event network-changed:4233280a-c63e-4ca7-a753-38d15f6bc316 for instance 11791c39-5002-4ba0-81ef-4db63be706c5 on hv-cinder-84131 May 10 20:09:40.833861 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-b61deb0f-6f2b-4329-97d2-0b62d7e7b9da req-669a6890-4279-4209-9cf4-8fd6af602dc1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030292 May 10 20:09:40.834487 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 471/965] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:41.137388 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-91341df7-e272-4f36-ab48-8d30a13ffaed tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:41.138325 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-91341df7-e272-4f36-ab48-8d30a13ffaed tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:41.144718 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91341df7-e272-4f36-ab48-8d30a13ffaed tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:41.145178 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91341df7-e272-4f36-ab48-8d30a13ffaed tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:41.145960 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91341df7-e272-4f36-ab48-8d30a13ffaed tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:41.146408 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91341df7-e272-4f36-ab48-8d30a13ffaed tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:41.175780 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-91341df7-e272-4f36-ab48-8d30a13ffaed tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042412 May 10 20:09:41.176349 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 495/966] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 20:09:41 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:09:41.189105 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-772247b0-e1a5-444a-a9b4-d0dd238501d4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:41.189706 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-772247b0-e1a5-444a-a9b4-d0dd238501d4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:41.196290 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-772247b0-e1a5-444a-a9b4-d0dd238501d4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:41.196742 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-772247b0-e1a5-444a-a9b4-d0dd238501d4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:41.198032 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-772247b0-e1a5-444a-a9b4-d0dd238501d4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:41.198483 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-772247b0-e1a5-444a-a9b4-d0dd238501d4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:41.274837 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-772247b0-e1a5-444a-a9b4-d0dd238501d4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] HTTP exception thrown: Instance 11791c39-5002-4ba0-81ef-4db63be706c5 is not attached to volume df9b1d15-ddba-4237-ba4b-016ccfbbf79f May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-772247b0-e1a5-444a-a9b4-d0dd238501d4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Request method failure captured: May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: DELETE /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/os-volume_attachments/df9b1d15-ddba-4237-ba4b-016ccfbbf79f HTTP/1.1 May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesYOz3hR3Sv_iD2mmapxOeFqPL_zI01_Rc2bQV4lntMoalYEezrCDgf5Dlk06fgPjbqDRrD-rtWhbvP_JhWViReNX7n-cqVIJultWjCCGjm7UBISX8o1ZmeebWTl8dIETV_7K5JpS6c32hU6O2dRygNgb7Oh6ZUPT6fSh0HCvZNJH5M May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: b52def9bc7f1456398c9f2ad21235015 May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-TestMinimumBasicScenario-1541491898 May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:09:41.277931 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:09:41.279771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b52def9bc7f1456398c9f2ad21235015"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b52def9bc7f1456398c9f2ad21235015", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b52def9bc7f1456398c9f2ad21235015"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b52def9bc7f1456398c9f2ad21235015"}]}] May 10 20:09:41.279771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-TestMinimumBasicScenario-1541491898 May 10 20:09:41.279771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: b52def9bc7f1456398c9f2ad21235015 May 10 20:09:41.279771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1541491898 May 10 20:09:41.279771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-TestMinimumBasicScenario-1541491898-project May 10 20:09:41.279771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:09:41.279771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:09:41.279771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: e239c11d804746c4a68ded15127755c1 May 10 20:09:41.279771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-TestMinimumBasicScenario-1541491898-project May 10 20:09:41.279771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:09:41.279771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 11791c39-5002-4ba0-81ef-4db63be706c5 is not attached to volume df9b1d15-ddba-4237-ba4b-016ccfbbf79f May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'server_id': '11791c39-5002-4ba0-81ef-4db63be706c5', 'id': 'df9b1d15-ddba-4237-ba4b-016ccfbbf79f'} May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id df9b1d15-ddba-4237-ba4b-016ccfbbf79f. May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:09:41.280697 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11791c39-5002-4ba0-81ef-4db63be706c5 is not attached to volume df9b1d15-ddba-4237-ba4b-016ccfbbf79f May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11791c39-5002-4ba0-81ef-4db63be706c5 is not attached to volume df9b1d15-ddba-4237-ba4b-016ccfbbf79f May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:09:41.282566 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-772247b0-e1a5-444a-a9b4-d0dd238501d4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Returning 404 to user: Instance 11791c39-5002-4ba0-81ef-4db63be706c5 is not attached to volume df9b1d15-ddba-4237-ba4b-016ccfbbf79f {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:09:41.283712 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-772247b0-e1a5-444a-a9b4-d0dd238501d4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "DELETE /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/os-volume_attachments/df9b1d15-ddba-4237-ba4b-016ccfbbf79f" status: 404 len: 154 microversion: 2.1 time: 0.095914 May 10 20:09:41.283712 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 472/967] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 20:09:41 2022] DELETE /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5/os-volume_attachments/df9b1d15-ddba-4237-ba4b-016ccfbbf79f => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:09:42.411977 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b80ea754-e527-4c2a-aacc-a58486570a09 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:42.412475 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b80ea754-e527-4c2a-aacc-a58486570a09 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:42.419395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b80ea754-e527-4c2a-aacc-a58486570a09 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:42.419850 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b80ea754-e527-4c2a-aacc-a58486570a09 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:42.420652 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b80ea754-e527-4c2a-aacc-a58486570a09 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:42.421093 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b80ea754-e527-4c2a-aacc-a58486570a09 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:42.444547 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b80ea754-e527-4c2a-aacc-a58486570a09 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:09:42.516718 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b80ea754-e527-4c2a-aacc-a58486570a09 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "DELETE /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 204 len: 0 microversion: 2.1 time: 0.108506 May 10 20:09:42.517408 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 496/968] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:09:42 2022] DELETE /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:09:42.526388 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c64cf8cf-0a35-469e-a6d3-54d0f5c0c0a0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:42.527116 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c64cf8cf-0a35-469e-a6d3-54d0f5c0c0a0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:42.534147 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c64cf8cf-0a35-469e-a6d3-54d0f5c0c0a0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:42.534667 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c64cf8cf-0a35-469e-a6d3-54d0f5c0c0a0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:42.535622 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c64cf8cf-0a35-469e-a6d3-54d0f5c0c0a0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:42.536070 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c64cf8cf-0a35-469e-a6d3-54d0f5c0c0a0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:42.662948 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c64cf8cf-0a35-469e-a6d3-54d0f5c0c0a0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:09:42.671264 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c64cf8cf-0a35-469e-a6d3-54d0f5c0c0a0 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1554 microversion: 2.1 time: 0.149415 May 10 20:09:42.671847 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 473/969] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:09:42 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:09:43.689264 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cfd85892-cb13-46ba-a4f6-74ba087174c4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:43.689972 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cfd85892-cb13-46ba-a4f6-74ba087174c4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:43.696282 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cfd85892-cb13-46ba-a4f6-74ba087174c4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:43.696740 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cfd85892-cb13-46ba-a4f6-74ba087174c4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:43.697631 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cfd85892-cb13-46ba-a4f6-74ba087174c4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:43.698075 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cfd85892-cb13-46ba-a4f6-74ba087174c4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:43.825084 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cfd85892-cb13-46ba-a4f6-74ba087174c4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:09:43.832349 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cfd85892-cb13-46ba-a4f6-74ba087174c4 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1554 microversion: 2.1 time: 0.147297 May 10 20:09:43.832911 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 497/970] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:09:43 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:09:44.849290 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-747ad9c1-3113-4f03-9ec4-d73b762908c2 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:44.849839 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-747ad9c1-3113-4f03-9ec4-d73b762908c2 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:44.856274 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-747ad9c1-3113-4f03-9ec4-d73b762908c2 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:44.856737 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-747ad9c1-3113-4f03-9ec4-d73b762908c2 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:44.857514 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-747ad9c1-3113-4f03-9ec4-d73b762908c2 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:44.857991 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-747ad9c1-3113-4f03-9ec4-d73b762908c2 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:44.930992 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-747ad9c1-3113-4f03-9ec4-d73b762908c2 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e239c11d804746c4a68ded15127755c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52def9bc7f1456398c9f2ad21235015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:09:44.939383 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-747ad9c1-3113-4f03-9ec4-d73b762908c2 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 200 len: 1512 microversion: 2.1 time: 0.093941 May 10 20:09:44.940212 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 474/971] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:09:44 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:09:45.070337 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-57cea4cc-3123-4d4d-858f-b2afc3f93095 req-a078dc1c-99c5-451a-983e-afa78e1e97cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11791c39-5002-4ba0-81ef-4db63be706c5", "name": "network-vif-deleted", "tag": "4233280a-c63e-4ca7-a753-38d15f6bc316"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:09:45.079679 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-57cea4cc-3123-4d4d-858f-b2afc3f93095 req-a078dc1c-99c5-451a-983e-afa78e1e97cb service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:45.080114 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-57cea4cc-3123-4d4d-858f-b2afc3f93095 req-a078dc1c-99c5-451a-983e-afa78e1e97cb service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:45.093494 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-57cea4cc-3123-4d4d-858f-b2afc3f93095 req-a078dc1c-99c5-451a-983e-afa78e1e97cb service nova] Creating event network-vif-deleted:4233280a-c63e-4ca7-a753-38d15f6bc316 for instance 11791c39-5002-4ba0-81ef-4db63be706c5 on hv-cinder-84131 May 10 20:09:45.098179 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-57cea4cc-3123-4d4d-858f-b2afc3f93095 req-a078dc1c-99c5-451a-983e-afa78e1e97cb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117131 May 10 20:09:45.098831 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 498/972] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:09:45.956964 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-29466eed-16e6-485a-8504-ea571409f19f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:45.957616 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-29466eed-16e6-485a-8504-ea571409f19f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] [instance: 11791c39-5002-4ba0-81ef-4db63be706c5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:09:45.964771 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29466eed-16e6-485a-8504-ea571409f19f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:45.965221 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29466eed-16e6-485a-8504-ea571409f19f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:45.965995 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29466eed-16e6-485a-8504-ea571409f19f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:09:45.966436 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29466eed-16e6-485a-8504-ea571409f19f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:09:45.979432 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-29466eed-16e6-485a-8504-ea571409f19f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] HTTP exception thrown: Instance 11791c39-5002-4ba0-81ef-4db63be706c5 could not be found. May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-29466eed-16e6-485a-8504-ea571409f19f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Request method failure captured: May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: request: GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 HTTP/1.1 May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept: application/json May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Accept-Encoding: identity May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Connection: close May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Length: 0 May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Content-Type: application/json May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Host: 10.222.0.57 May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Openstack-System-Scope: None May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: User-Agent: python-urllib3/1.26.9 May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Auth-Token: gAAAAABiesYOz3hR3Sv_iD2mmapxOeFqPL_zI01_Rc2bQV4lntMoalYEezrCDgf5Dlk06fgPjbqDRrD-rtWhbvP_JhWViReNX7n-cqVIJultWjCCGjm7UBISX8o1ZmeebWTl8dIETV_7K5JpS6c32hU6O2dRygNgb7Oh6ZUPT6fSh0HCvZNJH5M May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Id: None May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Domain-Name: None May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Identity-Status: Confirmed May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Is-Admin-Project: True May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Id: default May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Domain-Name: Default May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Id: b52def9bc7f1456398c9f2ad21235015 May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Project-Name: tempest-TestMinimumBasicScenario-1541491898 May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Role: member,reader May 10 20:09:45.980963 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Roles: member,reader May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b52def9bc7f1456398c9f2ad21235015"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b52def9bc7f1456398c9f2ad21235015", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b52def9bc7f1456398c9f2ad21235015"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b52def9bc7f1456398c9f2ad21235015"}]}] May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant: tempest-TestMinimumBasicScenario-1541491898 May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Id: b52def9bc7f1456398c9f2ad21235015 May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1541491898 May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User: tempest-TestMinimumBasicScenario-1541491898-project May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Id: default May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Domain-Name: Default May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Id: e239c11d804746c4a68ded15127755c1 May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: X-User-Name: tempest-TestMinimumBasicScenario-1541491898-project May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: method: > May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: exception: Instance 11791c39-5002-4ba0-81ef-4db63be706c5 could not be found. May 10 20:09:45.982541 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: action_args: {'id': '11791c39-5002-4ba0-81ef-4db63be706c5'} May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11791c39-5002-4ba0-81ef-4db63be706c5 could not be found. May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:09:45.983395 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11791c39-5002-4ba0-81ef-4db63be706c5 could not be found. May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11791c39-5002-4ba0-81ef-4db63be706c5 could not be found. May 10 20:09:45.985031 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: ERROR nova.api.openstack.wsgi May 10 20:09:45.986693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-29466eed-16e6-485a-8504-ea571409f19f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Returning 404 to user: Instance 11791c39-5002-4ba0-81ef-4db63be706c5 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:09:45.986693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-29466eed-16e6-485a-8504-ea571409f19f tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5" status: 404 len: 111 microversion: 2.1 time: 0.029255 May 10 20:09:45.986693 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 475/973] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:09:45 2022] GET /compute/v2.1/servers/11791c39-5002-4ba0-81ef-4db63be706c5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:09:45.992074 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7406b333-cd74-42eb-b6fd-2829a8304503 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] Calling method '.version_select at 0x7fdd39116790>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:09:46.011493 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7406b333-cd74-42eb-b6fd-2829a8304503 tempest-TestMinimumBasicScenario-1541491898 tempest-TestMinimumBasicScenario-1541491898-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-343447002" status: 202 len: 0 microversion: 2.1 time: 0.024037 May 10 20:09:46.012074 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 499/974] 10.222.0.57 () {58 vars in 1268 bytes} [Tue May 10 20:09:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-343447002 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:10:07.112458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-457986bd-29cf-4863-8ae0-dc9b3c0311a9 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:07.113038 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-457986bd-29cf-4863-8ae0-dc9b3c0311a9 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:10:07.117990 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-6d28a0e7-46fd-4d18-8e43-8989038ba3ab req-0b074775-0fce-4d19-887b-500743baa49d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee2f0ef-9109-4453-9767-472abca04ffe", "tag": "59264579-f015-4414-9410-630bf057f4aa"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:10:07.119381 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-457986bd-29cf-4863-8ae0-dc9b3c0311a9 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:07.119836 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-457986bd-29cf-4863-8ae0-dc9b3c0311a9 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:07.120605 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-457986bd-29cf-4863-8ae0-dc9b3c0311a9 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:07.121039 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-457986bd-29cf-4863-8ae0-dc9b3c0311a9 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:07.128289 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-6d28a0e7-46fd-4d18-8e43-8989038ba3ab req-0b074775-0fce-4d19-887b-500743baa49d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:07.128736 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-6d28a0e7-46fd-4d18-8e43-8989038ba3ab req-0b074775-0fce-4d19-887b-500743baa49d service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:07.139862 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-6d28a0e7-46fd-4d18-8e43-8989038ba3ab req-0b074775-0fce-4d19-887b-500743baa49d service nova] Creating event network-changed:59264579-f015-4414-9410-630bf057f4aa for instance 9ee2f0ef-9109-4453-9767-472abca04ffe on hv-cinder-84131 May 10 20:10:07.145047 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-6d28a0e7-46fd-4d18-8e43-8989038ba3ab req-0b074775-0fce-4d19-887b-500743baa49d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030586 May 10 20:10:07.145830 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 500/975] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:10:07.146940 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-457986bd-29cf-4863-8ae0-dc9b3c0311a9 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:10:07.229218 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-457986bd-29cf-4863-8ae0-dc9b3c0311a9 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 204 len: 0 microversion: 2.1 time: 0.119869 May 10 20:10:07.233045 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 476/976] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 20:10:07 2022] DELETE /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:10:07.239023 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bbf178b0-6a49-4419-942c-587d3f723eb1 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:07.239889 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bbf178b0-6a49-4419-942c-587d3f723eb1 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:10:07.248595 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bbf178b0-6a49-4419-942c-587d3f723eb1 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:07.249050 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bbf178b0-6a49-4419-942c-587d3f723eb1 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:07.249829 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bbf178b0-6a49-4419-942c-587d3f723eb1 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:07.250267 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bbf178b0-6a49-4419-942c-587d3f723eb1 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:07.408787 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bbf178b0-6a49-4419-942c-587d3f723eb1 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:10:07.416591 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bbf178b0-6a49-4419-942c-587d3f723eb1 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.182221 May 10 20:10:07.417387 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 501/977] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:10:07 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:10:08.434862 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e3c979d1-fc5f-4d1b-afef-94e5c0b2fd94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:08.435478 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e3c979d1-fc5f-4d1b-afef-94e5c0b2fd94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:10:08.441747 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3c979d1-fc5f-4d1b-afef-94e5c0b2fd94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:08.442200 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3c979d1-fc5f-4d1b-afef-94e5c0b2fd94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:08.443002 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3c979d1-fc5f-4d1b-afef-94e5c0b2fd94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:08.443438 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3c979d1-fc5f-4d1b-afef-94e5c0b2fd94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:08.572037 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e3c979d1-fc5f-4d1b-afef-94e5c0b2fd94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:10:08.579371 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e3c979d1-fc5f-4d1b-afef-94e5c0b2fd94 tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1569 microversion: 2.1 time: 0.149520 May 10 20:10:08.579946 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 477/978] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:10:08 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:10:09.598863 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f6dbbc9a-3727-444a-85a1-2ae2956b318e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:09.599464 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f6dbbc9a-3727-444a-85a1-2ae2956b318e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:10:09.605375 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6dbbc9a-3727-444a-85a1-2ae2956b318e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:09.605844 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6dbbc9a-3727-444a-85a1-2ae2956b318e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:09.606724 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6dbbc9a-3727-444a-85a1-2ae2956b318e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:09.607171 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6dbbc9a-3727-444a-85a1-2ae2956b318e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:09.683994 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f6dbbc9a-3727-444a-85a1-2ae2956b318e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48870723aed043be9db4f5923a05e8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8820e6b7a04ca89202e7b7ed991f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:10:09.691532 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f6dbbc9a-3727-444a-85a1-2ae2956b318e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 200 len: 1382 microversion: 2.1 time: 0.098263 May 10 20:10:09.692230 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 502/979] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:10:09 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 1382 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:10:09.715624 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-3494035e-7e37-411b-a1ac-5a91eb59f1b2 req-51b60376-cda1-432c-9905-123459b15365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee2f0ef-9109-4453-9767-472abca04ffe", "name": "network-vif-deleted", "tag": "59264579-f015-4414-9410-630bf057f4aa"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:10:09.725082 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-3494035e-7e37-411b-a1ac-5a91eb59f1b2 req-51b60376-cda1-432c-9905-123459b15365 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:09.725528 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-3494035e-7e37-411b-a1ac-5a91eb59f1b2 req-51b60376-cda1-432c-9905-123459b15365 service nova] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:09.736853 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-3494035e-7e37-411b-a1ac-5a91eb59f1b2 req-51b60376-cda1-432c-9905-123459b15365 service nova] Creating event network-vif-deleted:59264579-f015-4414-9410-630bf057f4aa for instance 9ee2f0ef-9109-4453-9767-472abca04ffe on hv-cinder-84131 May 10 20:10:09.741955 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-3494035e-7e37-411b-a1ac-5a91eb59f1b2 req-51b60376-cda1-432c-9905-123459b15365 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029980 May 10 20:10:09.742912 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 478/980] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 20:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:10:10.710530 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c2065207-15ed-4290-9ab7-421015be6f9d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:10.711149 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c2065207-15ed-4290-9ab7-421015be6f9d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] [instance: 9ee2f0ef-9109-4453-9767-472abca04ffe] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:10:10.718120 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2065207-15ed-4290-9ab7-421015be6f9d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:10.718619 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2065207-15ed-4290-9ab7-421015be6f9d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:10.719383 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2065207-15ed-4290-9ab7-421015be6f9d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:10:10.719821 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2065207-15ed-4290-9ab7-421015be6f9d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Lock "8204c3b4-68ac-47e6-ab11-d602a48c1ae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:10:10.732773 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-c2065207-15ed-4290-9ab7-421015be6f9d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] HTTP exception thrown: Instance 9ee2f0ef-9109-4453-9767-472abca04ffe could not be found. May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c2065207-15ed-4290-9ab7-421015be6f9d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Request method failure captured: May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: request: GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe HTTP/1.1 May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept: application/json May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Accept-Encoding: identity May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Connection: close May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Length: 0 May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Content-Type: application/json May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Host: 10.222.0.57 May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Openstack-System-Scope: None May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: User-Agent: python-urllib3/1.26.9 May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Auth-Token: gAAAAABiesWcXZOIxrufvX9WC2yg_JPj8iI58bbagQVXKw61LGZVxfAw-FVkItSo7C6TLb32D9JZw1jpiJ65bCKU5eQAkkGXTN9k5gDhK69nTuSPfx5HWjmAYND0FGk4NP2GVvu9TcJn0lcuDSLZdU_jYnxTSuaV2rIpe8ztBvdRxWmzwRqhdsE May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Id: None May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Domain-Name: None May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Identity-Status: Confirmed May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Is-Admin-Project: True May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Id: default May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Domain-Name: Default May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Id: 4d8820e6b7a04ca89202e7b7ed991f9a May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Project-Name: tempest-TestShelveInstance-1427460136 May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Role: member,reader May 10 20:10:10.734395 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Roles: member,reader May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8820e6b7a04ca89202e7b7ed991f9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4d8820e6b7a04ca89202e7b7ed991f9a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4d8820e6b7a04ca89202e7b7ed991f9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4d8820e6b7a04ca89202e7b7ed991f9a"}]}] May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant: tempest-TestShelveInstance-1427460136 May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Id: 4d8820e6b7a04ca89202e7b7ed991f9a May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-Tenant-Name: tempest-TestShelveInstance-1427460136 May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User: tempest-TestShelveInstance-1427460136-project May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Id: default May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Domain-Name: Default May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Id: 48870723aed043be9db4f5923a05e8c2 May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: X-User-Name: tempest-TestShelveInstance-1427460136-project May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: method: > May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: exception: Instance 9ee2f0ef-9109-4453-9767-472abca04ffe could not be found. May 10 20:10:10.736106 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: action_args: {'id': '9ee2f0ef-9109-4453-9767-472abca04ffe'} May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee2f0ef-9109-4453-9767-472abca04ffe could not be found. May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:10:10.737094 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee2f0ef-9109-4453-9767-472abca04ffe could not be found. May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee2f0ef-9109-4453-9767-472abca04ffe could not be found. May 10 20:10:10.738783 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: ERROR nova.api.openstack.wsgi May 10 20:10:10.740191 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c2065207-15ed-4290-9ab7-421015be6f9d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Returning 404 to user: Instance 9ee2f0ef-9109-4453-9767-472abca04ffe could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:10:10.740191 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c2065207-15ed-4290-9ab7-421015be6f9d tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe" status: 404 len: 111 microversion: 2.1 time: 0.029204 May 10 20:10:10.740191 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 503/981] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 20:10:10 2022] GET /compute/v2.1/servers/9ee2f0ef-9109-4453-9767-472abca04ffe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:10:10.896089 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1e30ab49-e395-4837-b45b-66bd51f4d41e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] Calling method '.version_select at 0x7fdd399c1550>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:10:10.916623 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1e30ab49-e395-4837-b45b-66bd51f4d41e tempest-TestShelveInstance-1427460136 tempest-TestShelveInstance-1427460136-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-694685838" status: 202 len: 0 microversion: 2.1 time: 0.025073 May 10 20:10:10.917458 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 479/982] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 20:10:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-694685838 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:11:16.874190 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:11:16.874897 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Tue May 10 20:11:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:13:02.469009 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:13:02.469652 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Tue May 10 20:13:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:13:17.812040 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:13:17.812672 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Tue May 10 20:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:13:25.118018 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:13:25.118647 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Tue May 10 20:13:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:13:30.423332 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:13:30.423986 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Tue May 10 20:13:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:14:36.883079 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:14:36.883741 dv-cinder-841315-1-iscsi devstack@n-api.service[117124]: Tue May 10 20:14:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:14:57.224630 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:14:57.225278 dv-cinder-841315-1-iscsi devstack@n-api.service[117125]: Tue May 10 20:14:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!